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SYSTEMS AND METHODS FOR CORRELATING IMAGES IN AN IMAGE 
CORRELATION SYSTEM WITH REDUCED COMPUTATIONAL LOADS 

BACKGROUND OF THE INVENTION 

1. Field of Invention 
5 [0001] This invention is directed to image correlation systems. 

2. Description of Related Art 
[0002] Various known devices use images acquired by a sensor array, and 

correlation between images acquired by the sensor array, to determine deformations 
and/or displacements. For example, one class of such devices is based on acquiring a 
1 0 speckle image generated by illuminating an optically rough surface with a light 
source. Generally, the light source is a coherent light source, such as a laser- 
generating light source. Such laser-generating light sources include a laser, laser 
diode and the like. After the optically rough surface is illuminated by the light source, 
the light scattered from the optically rough surface is imaged onto an optical sensor. 
1 5 The optical sensor can be a charge-couple device (CCD), a semi-conductor image 
sensor array, such as a CMOS image sensor array, or the like. 

[0003] Prior to displacing or deforming the optically rough surface, a first 
initial speckle image is captured and stored. Then, after displacing or deforming the 
optically rough surface, a second or subsequent speckle image is captured and stored. 
20 Conventionally, the first and second speckle images are then compared in their 
entireties on a pixel-by-pixel basis. In general, a plxirality of comparisons are 
performed. In each comparison, the first and second speckle images are offset, or 
spatially translated, relative to each other. Between each comparison, the amount of 
offset, or spatial translation, is increased by a known amount, such as one image 
25 element, or pixel, or an integer number of image elements or pixels. 

[0004] In each comparison, the image value of a particular pixel in the 
reference image is multiplied by, subtracted from, or otherwise mathematically used in 
a function with, the image value of the corresponding second image pixel, where the 
corresponding second image pixel is determined based on the amount of offset. The 
30 value resulting from each pixel-by-pixel operation is accumulated with values 
resulting from the operation performed on every other pixel of the images to 
determine a correlation value for that comparison between the first and second 
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images. That correlation value is then, in effect, plotted against the offset amount, or 
spatial translation position, for that comparison to determine a correlation fiinction 
value point. The offset having the greatest correlation between the reference and first 
images will generate a peak, or a trough, depending on how the pixel-by-pixel 
5 comparison is performed, in the plot of correlation function value points. The offset 
amount corresponding to the peak or trough represents the amount of displacement or 
deformation between the first and second speckle images. 

[0005] U.S. Patent AppHcation No. 09/584,264, which is incorporated 
herein by reference in its entirety, discloses a variety of different embodiments of a 

10 speckle-image-based optical transducer. As disclosed in the 264 application, such 
image-based correlation systems can move the surface being imaged relative to the 
imaging system in one or two dimensions. Furthermore, the surface being imaged 
does not need to be planar, but can be curved or cylindrical. Systems having two 
dimensions of relative motion between the surface being imaged and the imaging 

1 5 system can have the surface being imaged effectively planar in one dimension and 

effectively non-planar in a second dimension, such as, for example, a cylinder which 
can rotate on its axis passed the imaging systems, while the cylindrically surface is 
translated past the imaging system along its axis. 

[0006] U.S. Patent Application No. 09/731,671, which is incorporated 

20 herein by reference in its entirety, discloses systems and methods for high-accuracy 
displacement determination in a correlation-based position transducer. In the 671 
application, a system is provided that estimates the sub-pixel displacement of images 
in correlation-based position transducers and the like. The system then rejects the 
systematic displacement estimation errors present when conventional sub-pixel 

25 estimation methods are applied to a number of correlation function value points, 
especially when the correlation function value points are arranged asymmetrically. 

[0007] However, in the above-described conventional image correlation 
systems, the computational loads required to determine the correlation function value 
over the entire image for each offset position are often extremely high. Accordingly, 

30 in "Hierarchical Distributed Template Matching" by M. Hirooka et al.. Machine 

Vision Applications and Industrial Inspection V . Proceedings of SPIE, February 10- 
11, 1997, San Jose, California, and "Coarse-Fine Template Matching" by A. 
Rosenfeld et al., in IEEE Transactions on Systems, Man and Cvbemetics . pages 
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104-107, February 1977, various techniques are described that reduce the 
computational load by reducing the resolution of the images to be correlated. In 
particular, in both of these papers, the image resolution is reduced by averaging the 
image values of a number of pixels to create a "shrunken" image having a reduced 
5 number of pixels. The image correlation is then performed on a pixel-by-pixel basis 
for each offset position for the reduced resolution images. Once the general area of 
the greatest correlation is identified, the original, full-resolution images are compared 
on a pixel-by-pixel basis for each offset position in this area only. 

[0008] Similarly, in "A Two-Stage Cross Correlation Approach To Template 

10 Matching" by A. Goshtasby et al., IEEE Transactions on Pattern Analvsis and 

Machine Intelligence , Vol. 6, No. 3, May 1984, a different two-stage technique is 
disclosed. In this paper, rather than reducing the resolution of the entire image, as in 
Rosenfeid et al. and Hirooka et al., a limited number of the pixels in the images to be 
correlated are compared for every image offset position to generate a correlation 

1 5 function. Like Hirooka et al. and Rosenfeid et al., a reduced number of pixels are 
used in the comparison. However, unlike Hirooka et al. and Rosenfeid et al., the 
pixels used are at full resolution but do not represent the entire image to be compared. 
As in Hirooka et al. and Rosenfeid et al., in this technique, once an area of high 
correlation is identified using the reduced number of pixels only, that area is further 

20 analyzed using all of the pixels of the images to be compared for each offset position. 

[0009] In contrast to the reduced resolution technique disclosed in Hirooka 
et al. and Rosenfeid et al., and in contrast to the limited portion of the full resolution 
image technique used in Goshtasby et al., in "Advances in Picture Coding" by H. G. 
Musmann et al.. Proceedings of the IEEE. Vol. 73, No. 4, April 1985, pages 523-548, 

25 two techniques are discussed that search a number of coarsely-spaced search points 

around a center search point. At each such search point, a full image correlation value 
is determined. Then, some analysis of the obtained correlation values is performed. 
These analyses generally indicate the direction of the correlation peak or trough 
relative to the coarsely-spaced search points. The coarsely-spaced search point that 

30 lies closest to the direction of the correlation peak or trough is then selected as the 
center point around which a further number of coarsely-spaced search points will be 
selected. This procedure proceeds iteratively xmtil the correlation peak or trough is 
identified. However, at no time is any reduced representation of the images such as 
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those disclosed in Hirooka et al., Rosenfeld et al. or Goshtasby et al. used. Likewise, 
while the techniques disclosed in Musmann et al. collapse the sparsely spaced search 
points around the central point as the central point approaches the correlation peak or 
trough, each iteration uses the same number of coarsely- spaced points. 

SUMMARY OF THE INVENTION 
[0010] U.S. Patent Application 09/860,636, which is incorporated herein by 
reference in its entirety, discloses systems and methods for reducing the accumulation 
of systematic displacement errors in image correlation systems that use reference 
images. In particular, the 636 application discloses various methods for reducing the 
amount of system resources that are required to determine the correlation value for a 
particular positional displacement or offset of the second image relative to the first 
image. 

[0011] In all of Hirooka et al, Rosenfeld et al., Goshtasby et al. and 
Musmann et al. described above, the disclosed techniques are useful for low spatial 
frequency grayscale images, low spatial frequency maps, and low spatial frequency 
video images. However, the resolution reduction or averaging techniques disclosed in 
Hirooka et al. and Rosenfeld et al. are generally inapplicable to high spatial frequency 
images, such as speckle images, images resembling siirface texture, and high density 
dot patterns and the like. This is because such resolution, reduction or spatial 
averaging tends to "average-out" or remove the various spatial features which are 
necessary to determine an accurate correlation value in such high spatial frequency 
images. 

[0012] In a similar vein, the subtemplate created by taking a set of N 
randomly selected data points from a template with N^ data points, as disclosed in 
Goshtasby et al., is also inapplicable to such high spatial frequency images. In the 
low-spatial-frequency images used in Goshtasby et al., each randomly selected data 
point (or pixel value) is likely to be substantially similar in image value to the 
surrounding data points (or pixel values). Thus, each data point contributes 
substantially the same amount to the correlation value. In contrast, in high-spatial- 
frequency images, such as speckle images, the image value of each pixel is likely to be 
significantly different than the image values of the adjacent pixels. As a resuh, if the 
pixels to be used in the first stage of the image correlation process are randomly 
selected in such high-spatial frequency images, the resulting image correlation value 
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for the actual offset position is likely to be indistinguishable from the image 
correlation values for other offset amounts. 

[0013] The coarsely-spaced search point techniques discussed in Musmaim 
et al. are also generally inapplicable to such high-spatial-frequency images. In 
5 particular, such high-spatial-frequency images will generally have a "landscape" of the 
correlation function that is substantially flat or regular within a substantially limited 
range away from the actual offset position and substantially steep or irregular only in 
offset positions that are very close to the actual offset position. That is, for offset 
positions away from the actual offset position, the correlation value will vary only in a 

1 0 regular way and within a limited range from an average value, except in a very narrow 
range around the actual offset position. In this very narrow range around the actual 
offset position, the correlation value will depart significantly from the other regular 
variations and their average value. 

[0014] In contrast, the coarsely-spaced search point techniques disclosed in 

15 Musmarm et al. rely on the "landscape" of the correlation function having a significant 
gradient indicative of the direction of the correlation peak at all points. This allows an 
analysis of any set of coarsely-spaced search points to clearly point in the general 
direction of the correlation fiinction peak or trough. However, applying the coarsely- 
spaced search techniques disclosed in Musmann et al. to a correlation function having 

20 a substantially flat or regular landscape except around the correlation peak or trough 
will result in no clear direction towards the correlation function peak or trough being 
discernible, unless one of the coarsely-spaced search points happens to randomly fall 
within the very narrow range of correlation values that depart fi-om the regular 
variations and their average value. However, as should be appreciated by those 

25 skilled in the art, this has a very low probability of occurring in the particular coarsely- 
spaced search point techniques disclosed in Musmann et al. 

[0015] Thus, the inventor has determined that high-resolution imaging 
systems and/or image correlation systems that allow for displacement along two 
dimensions still consume too large a portion of the available system resources when 

30 determining the correlation values for every positional displacement or offset. 
Additionally, even systems that allow for relative displacement only along one 
dimension would also benefit from a reduction in the amount of system resources 
consumed when determining the correlation displacement. 
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[0016] Accordingly, there is a need for systems and methods which are able 
to accurately to determine the peak or trough of the correlation function while 
reducing the amount of system resources needed to perform the correlation operations. 

[0017] This invention provides systems and methods that accurately allow 
5 the location of a correlation peak or trough to be determined. 

[0018] This invention further provides systems and methods that allow the 
location of the correlation peak or trough to be determined while consuming fewer 
system resources than conventional prior art methods and techniques. 

[0019] This invention separately provides systems and methods for 
1 0 accurately determining the location of the correlation peak or trough while sparsely 
determining the correlation function. 

[0020] This invention further provides systems and methods that allow the 
location of the correlation peak or trough to be determined for a two-dimensional 
correlation function using a grid of determined correlation values. 
1 5 [0021] This invention separately provides systems and methods for 

accurately determining the location of the correlation peak or trough for a pair of high- 
spatial-frequency images. 

[0022] This invention separately provides systems and methods for 
accurately determining the location of the correlation peak or trough for images that 
20 have correlation function landscapes that are substantially flat or regular in regions 
away from the correlation peak or trough. 

[0023] This invention separately provides systems and methods for 
accurately determining the location of the correlation peak or trough while sparsely 
determining the correlation function for a subset of the image to be correlated. 
25 J0024] This invention further provides systems and methods that identify a 

portion of the correlation function in which the correlation peak or trough is likely to 
lie without performing a correlation operation between the first and second image. 

[0025] This invention separately provides systems and methods that allow a 
magnitude and/or direction of movement to be estimated from a single image captured 
30 by the image correlation system. 

[0026] This invention further provides systems and methods for refining the 
estimated displacement distance or offset and/or direction on an analysis of only the 
second captured image. 
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[0027] This invention additionally provides systems and methods that use 
the determined and/or refined displacement distance and/or direction values to 
identify a portion of the correlation fimction in which the correlation peak is likely to 
lie. 

5 [0028] This invention separately provides systems and methods that 

determine a magnitude and/or a direction of relative motion between the surface to be 
imaged and the imaging system based on auto-correlation of the first and/or second 
images. 

[0029] This invention ftirther provides systems and methods for determining 

1 0 the magnitude and/or direction of relative motion based on at least one characteristic 
of the auto-correlation peak. 

[0030] This invention separately provides systems and methods that are 
especially suitable for measuring displacement of a surface using speckle images. 
[0031] The systems and methods according to this invention will be 

1 5 described with respect to sensor "images", where the term "image" is not limited to 

optical images, but refers more generally to any one-dimensional, two-dimensional, or 
higher-dimensional, arranged set of sensor values. Similarly, the term "pixel" as used 
herein is not limited to optical picture elements, but refers more generally to the 
granularity of the one-dimensional, two-dimensional or higher-dimensional arranged 

20 set of sensor values. It should be appreciated that the term "image" is not limited to 
entire images but refers more generally to any image portion that includes a one- 
dimensional, two-dimensional, or higher-dimensional arranged set of sensor values. 

[0032] In various exemplary embodiments of the correlation systems and 
methods according to this invention, after the first and second correlation images are 

25 obtained, signal generating and processing circuitry begins performing the correlation 
function using the first and second images to determine a sparse set of image 
correlation function value points. In such exemplary embodiments where the surface 
to be imaged moves only on a one-dimensional path relative to the imaging system, 
the sparse set of image correlation function value points are taken along only a single 

30 dimension. In contrast, in various exemplary embodiments that allow for relative 

movement along two dimensions, the sparse sample set of image correlation function 
value points form a grid in the two-dimensional correlation function space. 
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[0033] In general, in various exemplary embodiments, the width of the 
correlation peak is relatively small relative to the length or width of the imaging array 
along the single dimension in a one-dimensional system or along each of the two 
dimensions in a two-dimensional system have imaging arrays. In general, in these 
5 various exemplary embodiments, the value of the correlation function in areas away 
from the correlation peak generally varies only within a limited range away from an 
average value. It should be appreciated that the sparse set of image correlation 
function value points can be as sparse as desired so long as the location of the 
correlation peak can be identified to a first, relatively low resolution, without having 
10 to determine the correlation function value for every possible displacement distance or 
offset. 

[0034] For a high- spatial-frequency, non-repetitive image, where the 
frequency of the spatial features in the captured image is on the order of the 
dimensions of the pixels of the image capturing system, the correlation function will 

1 5 have, in general, a single, unique, peak or trough. As a result, as shown in Figs. 3, 5 
and 7-9, except in the area immediately surrounding the correlation peak or trough, 
the correlation function will have generally the same background or average value. 
Thus, any correlation function value that occurs in sparse set of image correlation 
function value points that departs substantially from a limited range around the 

20 average backgroimd value tends to identify the peak in such images. 

[0035] In contrast, in any type of repetitive image, multiple peaks, each 
having the same size, will be created. Because such images do not have a uniquely 
extreme correlation frmction peak and/or trough, the sparsely determined correlation 
ftmction according to this invention cannot be reliably used on such images. Finally, 

25 with respect to non-repetitive images that have features having spatial frequencies that 
are significantly lower than the spatial resolution of the image array, any number of 
irregular local peaks or troughs, in addition to the true correlation peak or trough, can 
occur in the image correlation frmction. As such, the background value is reliably 
representative of a particular portion of the correlation frmction and any correlation 

30 position having an image value that significantly departs from the background value 
of the image correlation ftmction identifies at least a local peak or trough in the image 
correlation function space. 
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[0036] It should be appreciated that, in various exemplary embodiments, the 
image correlation value determined at one of the image correlation function value 
points of the sparse set of image correlation function value points locations can be a 
full pixel-by-pixel correlation over the entire two-dimensional extent of the first and 
5 second images. However, since it is highly unlikely one of the sparse set of image 

correlation function value points locations is the true peak or trough of the correlation 
function, such accuracy is uimecessary. As a result, in various other exemplary 
embodiments, only one, or a small number, of the rows and/or columns of the first and 
second images are correlated to each other. 

1 0 [0037] This does not result in an image correlation value that is as accurate 

as possible. However, because the sampling location is used merely to indicate where 
further, more precise analysis should be performed, this lack of precision can be 
ignored, especially in light of the significant reduction in the amount of system 
resources required to determine the correlation function value for this sample location 

15 in these exemplary embodiments. This is especially true when the current sampling 
location is one of a two-dimensional grid over the two-dimensional correlation space 
that occurs when the surface to be imaged can move in two dimensions relative to the 
image system. 

[0038] In various exemplary embodiments, at least one correlation peak or 
20 trough is identified for the image correlation fimction. Then, all of the image 
correlation sampling locations in the correlation fimction space within a 
predetermined distance, or within dynamically determined distance, to each such peak 
or trough location are determined. The determined image correlation sampling 
locations are analyzed to identify the displacement point having the image correlation 
25 value that is closet to the true peak or trough of the image correlation function. Again, 
it should be appreciated that, in some exemplary embodiments, this correlation can be 
performed in full based on a pixel-by-pixel comparison of all of the pixels in the first 
and second images. 

[0039] Alternatively, in various other exemplary embodiments, the image 
30 correlation values for these image correlation locations surrounding the sparsely- 
determined peak or trough can be determined using the reduced-accuracy and 
reduced-system-resource-demand embodiment discussed above to again determine, at 
a lower resolution, the location in the image correlation space that appears to lie 
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closest to the true peak or trough of the image correlation function. Then, for those 
locations that are within a second predetermined distance, or within a second 
dynamically determined distance, a more accurately determined image correlation 
peak or trough, the actual image correlation peak or trough can be identified as 
5 outlined in the 671 application. 

[0040] It should be appreciated that, in the exemplary embodiment outlined 
above, where the surface to be imaged has a non-repetitive but low-spatial-frequency 
image on that surface, each of these embodiments would be performed on each such 
identified peak or trough to determine the location of the actual correlation function 

1 0 peak or trough. 

[0041] In various other exemplary embodiments, in one or two-dimensional 
movement systems, rather than taking a sharp or distinct, i.e., "unsmeared", image by 
using a high effective "shutter speed" for the imaging system, "smeared" images can 
be obtained by using a slow shutter speed. Because the surface to be imaged will 

1 5 move relative to the imaging system during the time that the shutter is effectively 
open, the resulting smeared images will have the long axes of the smeared image 
features aligned with the direction of relative movement between the surface to be 
imaged and the imaging system. Additionally, the lengths of the long axes of the 
smeared image features, relative to the axes of the same features obtained along the 

20 direction of motion using a high shutter speed, is closely related to the magnitude of 
the motion, i.e., the velocity, of the surface to be imaged relative to the optical system. 

[0042] It should be appreciated that, for a one-dimensional system, the 
directional information is unnecessary, as by definition, the system is constrained to 
move only along a single dimension. In this case, the magnitude of the smear can be 

25 determined using the width of the correlation peak obtained by auto-correlating the 

smeared image with itself. The direction of the velocity vector can also be determined 
through auto-correlating the captured image with itself This is also true when the 
direction of relative motion is substantially aligned with one of the axes of the 
imaging array in a two-dimensional system. 

30 [0043] Once the direction and magnitude of the relative motion are 

determined, that information can be used to further reduce the number of sparse 
sampling locations of the correlation function space to be analyzed, i.e., the number of 
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image correlation function value points in the sparse set of image correlation function 
value points. 

[0044] Furthermore, if additional magnitude and direction information is 
obtained by auto-correlation from the second image, the accuracy of the direction and 
5 magnitude and components of the velocity vector can be further refined. 

[0045] In various other exemplary embodiments of the correlation systems 
and methods according to this invention, the systems and methods are particularly 
well-suited for application to speckle images, texture images, high-density dot images 
and other high-spatial frequency images. 
1 0 [0046] In various other exemplary embodiments of the correlation systems 

and methods according to this invention, the systems and methods are particularly 
well-suited to determining the general area within a two-dimensional correlation 
function space to reduce the load on the system resources while determining the 
location of the peak of the correlation function at high speed with high accuracy. 
1 5 [0047] These and other features and advantages of this invention are 

described in or are apparent from the following detailed description of various 
exemplary embodiments of the systems and methods according to this invention. 
BRIEF DESCRIPTION OF THE DRAWINGS 
[0048] Various exemplary embodiments of this invention will be described 
20 in detail, with reference to the following figures, wherein: 

Fig. 1 is a block diagram of a speckle-image correlation optical position 
transducer; 

Fig. 2 illustrates the relationship between a first image and a current second 
image and the portions of the first and second images used to generate the correlation 
25 values according to a conventional comparison technique; 

Fig. 3 is a graph illustrating the results of comparing the first and second 
images by using the conventional comparison technique and when using a 
conventional multiplicative correlation function, when the images are offset at 
successive pixel displacements; 
30 Fig. 4 illustrates the relationship between the first and second images and the 

portions of the first and second images used to generate the correlation values 
according to a first exemplary embodiment of a sparse set of image correlation 
function value points comparison technique according to this invention; 
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Fig. 5 is a graph illustrating the results of comparing the first and second 
images using a first exemplary embodiment of the sparse set of image correlation 
function value points comparison technique of Fig. 4 and using a conventional 
multiplicative correlation function; 
5 Fig. 6 illustrates the relationship between the first and second images and the 

portions of the first and second images used to generate the correlation values 
according to a second exemplary embodiment of a sparse set of image correlation 
function value points comparison technique according to this invention; 

Fig. 7 is a graph illustrating the results of comparing the first and second 
1 0 images using the second exemplary embodiment of the sparse set of image correlation 
function value points comparison technique of Fig. 6and using a conventional 
multiplicative correction function; 

Fig. 8 is a graph illustrating the relative shapes of the correlation function for 
different numbers of pixels used in the correlation function; 
1 5 Fig. 9 is a graph illustrating the results of comparing the first and second 

images using the conventional comparison technique and when using the conventional 
difference correlation function, when the images are offset in two dimensions at 
successive pixel displacements; 

Fig. 10 is a graph illustrating the results of comparing the first and second 
20 images using the first exemplary embodiment of the sparse set of image correlation 
function value points comparison technique according to this invention and using a 
conventional difference correlation function, when the images are offset in two 
dimensions at successive pixel displacements; 

Fig. 1 1 is a flowchart outlining a first exemplary embodiment of a method for 
25 using a sparse set of image correlation function value points locations in the 

correlation function space to locate a peak or trough to a first resolution according to 
this invention; 

Fig. 12 is a flowchart outlining a second exemplary embodiment of the method 
for using a sparse set of image correlation fiinction value points locations in the 
30 correlation function space to locate a peak or trough to a first resolution according to 
this invention; 
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Fig. 13 shows a first exemplary embodiment of smeared high-spatial- 
frequency image where the surface to be imaged moves relative to the image capture 
system along a single dimension; 

Fig. 14 shows a second exemplary embodiment of a smeared high-spatial- 
5 frequency image, where the surface to be imaged moves relative to the image capture 
system in two dimensions; 

Fig. 15 shows one exemplary embodiment of an unsmeared high-spatial- 
frequency image; 

Fig. 16 shows contour plots of the two-dimensional auto-correlation function 
10 for an unsmeared image and a smeared image; 

Fig. 17 illustrates the correlation function value points used to determine the 
smear amount for a two-dimensional auto-correlation function; 

Fig. 1 8 is a block diagram outlining a first exemplary embodiment of a signal 
generating and processing circuitry of an image-based optical position transducer 
15 suitable for providing images and for determining image displacements according to 
this invention. 

Fig. 1 9 is a block diagram outlining a second exemplary embodiment of a 
signal generating and processing circuitry of an image-based optical position 
transducer suitable for providing images and for determining image displacements 

20 according to this invention. 

DETAILED DESCRIPTION OF EXEMPLARY EMBODIMENTS 
[0049] Fig. 1 is a block diagram of a correlation-image-based optical position 
transducer 100. It should be appreciated that, in the following detailed description, 
the systems and methods according to this invention will be described primarily 

25 relative to a speckle-image-based optical position transducer and corresponding 
methods and techniques. However, it should be appreciated that the systems and 
methods according to this invention are not limited to such speckle-image-based 
correlation systems and methods. Rather, the systems and methods according to this 
invention can be used with any known or later-developed system or method for 

30 determining a positional displacement or offset that uses any known or later 

developed type of correlation image, including texture images, high-density dot 
images and the like, so long as the correlation image has a high spatial frequency 
and/or is not truly repetitive. Thus, while the following detailed description of the 
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exemplary embodiments may refer in particular to speckle-image-based optical 
positions transducers, correlation systems and/or correlation techniques, this is 
exemplary only and is not limiting of the foil scope and breadth of this invention. 

[0050] Herein, the offset value in pixels associated with the extremum of a 
5 true continuous correlation fonction will be called the peak offset regardless of 
whether the underlying correlation function produces a peak or a trough, and the 
surface displacement corresponding to the peak offset will be called the peak 
displacement, or simply the displacement, regardless of whether the underlying 
correlation function produces a peak or a trough. In particular, the correlation 

10 functions shown in Figs. 3 and 5, which have correlation function values displayed in 
arbitrary units, will exhibit an extremum of the true continuous correlation function 
205 at the offset value, or spatial translation position, where the image, or intensity, 
patterns in each of the first and second images best align. 

[0051] The speckle-image-based optical position transducer 100 shown in 

1 5 Fig. 1 includes a readhead 126, signal generating and processing circuitry 200 and an 
optically rough surface 104. In Fig. 1, the components of the readhead 126, and their 
relation to the optically rough surface 104, are shown schematically in a layout that 
generally corresponds to an exemplary physical configuration, as further described 
below. The correlation-image-based optical position transducer 100 that uses speckle 

20 images, as well as various suitable mechanical and optical configurations, image 
correlation methods, and associated signal processing circuitry, are described in 
greater detail in the incorporated 264 application. 

[0052] In particular, the optically diffusing, or optically rough, surface 104 is 
positioned adjacent to an illuminating and receiving end of the readhead 126, such 

25 that when optically rough surface 104 is illuminated by light emitted from that end of 
the readhead 126 by a light source 130, the emitted light is scattered back from the 
optically rough surface 104 towards the image receiving optical elements positioned at 
that end of the readhead 126. The optically rough surface 104 may be part of a 
specially-provided element, or it may be provided as an integral surface of a 

30 separately-existing mechanism. 

[0053] In either case, the optically rough surface 104 is positioned at a 
generally stable distance from the light source and an optical system housed in the 
readhead 126, and moves relative to readhead 126 along one or two axes of relative 
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motion, such as the measuring axes 1 10 and 1 12 in Fig. 1 . When motion in two 
dimensions is allowed, there are usually no constraints on the permitted motion within 
the lateral bounds of the two-dimensional area of the optically rough surface 104. 
When only a single dimension of relative motion is permitted, the relative motion is 

5 generally constrained along one of the measuring axes 1 10 or 1 12 by conventional 
guideways or bearings (not shown) mounted to a frame that maintains the proper 
relative position between the readhead 126 and the optically rough surface 104. The 
readhead 126 may include an alignment feature (not shown) which aids in mounting 
the readhead 126, and aligns the internal components of the readhead 126 relative to 

10 the mounting frame and/or the expected axis or axes of relative motion of the optically 
rough surface 104. 

[00541 As shown in Fig. 1 , the image receiving optical elements of the 
readhead 126 include a lens 140 positioned at the illuminating and receiving end of 
the readhead assembly 106 such that the optical axis of the lens 140 is generally 

1 5 aligned with the illuminated spot on the optically rough surface 104. The readhead 

126 further includes a pinhole aperture plate 150, spaced apart from the lens 140 along 
an optical axis, and a light detector 160 spaced apart from the aperture plate 150 along 
the optical axis, as shown in Fig. 1. The light detector 160 can be any known or later- 
developed type of light sensitive material or device that can be organized into an array 

20 of independent and individual light sensing elements, such as a camera, an electronic 
or digital camera, a CCD array, an array of CMOS light sensitive elements, or the like. 

[0055] An exemplary spacing and positioning of the optically rough surface 
104 and the readhead 126, including the lens 140, the aperture plate 150, and the light 
detector 1 60, is further described below and in the incorporated 264 application. The 

25 mounting of the light source 130, the lens 140, the aperture plate 150, and the light 
detector 160 in the housing of the readhead 126 may be done according to 
conventional methods of miniature optical system construction and/or industrial 
camera construction, so long as the components are mounted in a precise and stable 
manner. 

30 [0056] When the readhead 126 is suitably positioned adjacent to the 

optically rough surface 104, each image captured by the light detector 160 will contain 
a random pattern of relatively bright spots, or speckles, where the diffracted light 
waves from the optically rough surface 104 combine positively to form a peak, and 
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relatively dark spots where the diffracted light waves from the optically rough surface 
1 04 combine negatively to cancel out. The random pattern corresponding to any 
illuminated portion of the optically diffusing, or optically rough, surface 104 is 
unique. The optically rough surface 104 can therefore act as a displacement reference 
without the need for any special marks. 

[0057] The light detector 1 60 has an array 1 66 of image elements 1 62 
spaced apart along at least one axis at a known spacing. The known spacing provides 
the basis for measuring the displacement or offset between two images projected onto 
the light detector 160, and thus also provides the basis for measuring the displacement 
of the surface that determines the images, i.e., the optically rough surface 104. 

[0058] In general, however, the array 166 will extend in two dimensions 
along two orthogonal axes at a knovm spacing along each axis. This known spacing 
need not be the same for both axes. For systems that permit movement along only a 
single axes, the array 166 will often have an extent along that dimension that is much 
greater than the extent of the array 166 across that dimension. For systems that permit 
two-dimensional movements, the extent of the array 166 along each of the two 
orthogonal will be roughly on the same order of magnitude, but need not be exactly 
the same. 

[0059] In addition, the readhead 126 includes at least a portion of the signal 
generating and processing circuitry 200. As shown in Fig. 1, a signal line 132 from 
the signal generating and processing circuitry 200 is connected to the light source 130, 
to control and/or drive the light source 130. A signal line 164 connects the light 
detector 160 and the signal generating and processing circuitry 200. In particular, 
each of the image elements 162 of the array 166 can be individually addressed to 
output a value representing the light intensity on that image element 1 62 over the 
signal line 1 64 to the signal generating and processing circuitry 200. Additional 
portions of the signal generating and processing circuitry 200 may be placed remotely 
from the readhead 126, and the fimctions of the readhead 126 can be operated and 
displayed remotely. The signal generating and processing circuitry 200 is described in 
greater detail below, with respect to Figs. 18 and 19. 

[0060] Additional details regarding the structure and operation of this and 
other embodiments of the speckle-image-based optical position transducer 1 00 are 
provided below, and in the incorporated 264 application. 
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[0061] As shown in Fig. 1 , a light beam 1 34 is emitted by the light source 
130 and is directed onto the optically diffusing, or optically rough, surface 104 to 
illuminate a portion of the optically diffusing, or optically rough, surface 104. As a 
resuh, the illuminated portion of the optically diffusing, or optically rough, surface 
104 both scatters and diffracts light about the optical axis 144. 

[0062] When the light source 1 30 is a white-light source, the light will 
generate an image of the illuminated portion, which can be projected onto the array 
1 66 of the image elements 162. However, while this image can be correlated in the 
same way that a speckle image can be correlated, this image will not include speckles 
formed by scattering from the optically diffusing, or optically rough, surface 104. 

[0063] When the light source 1 30 is coherent and is driven by the drive 
signal on the signal line 132 and outputs the light beam 134 as a coherent light beam, 
the coherent light beam 134 illuminates a portion of the optically diffusing, or 
optically rough, surface 104. The illuminated portion lies along the optical axis 144 
of the optical system of the readhead 126. In particular, the light 136 scattered from 
the illuminated portion of the optically diffusing, or optically rough, surface 104 is 
gathered by the lens 140. 

[0064] The lens 140 then projects the collected light 142 from the 
illuminated portion of the optically diffusing, or optically rough, surface 104 onto the 
pinhole aperture plate 150 having the pinhole aperture 152. The lens 140 is spaced 
from the plate 150 by a distance f, which is equal to the focal length of the lens 140. 
The pinhole aperture plate 150 is spaced from the illuminated portion of the optically 
diffusing, or optically rough, surface 104 by a distance h. 

[0065] By locating the plate 1 50 at the focal distance f of the lens 140, the 
optical system of the speckle-image-based optical position transducer becomes 
telecentric. Moreover, by using the pinhole 152 in the pinhole plate 150, the speckle 
size and the dilation of the speckle pattern depends solely on the dimensions of the 
pinhole 152 and, more particularly, becomes independent of any lens parameters of 
the lens 140. 

[0066] The collected light 142 from the lens 140 passes through the pinhole 
1 52. In particular, the light 1 54 passed by the pinhole 1 52 is projected along the 
optical axis 144 and onto the array 166 of the image elements 162 of the light detector 
160. The surface of the array 166 of the light sensitive elements 162 is separated from 
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the plate 150 by a distance d. The speckle size depends only on the angle a subtended 
by the dimensions of the pinhole 152 and the distance d between the pinhole plate 150 
and the surface formed by the array 166 of image elements 162 of the light detector 
160. 

5 [0067] The approximate size D of the speckles within the detected portion of 

the light received from the illuminated portion of the optically diffusing, or optically 
rough, surface 104 onto the array 166 of the image elements 162 is: 

/tan(a) = (X*d)/w (1) 

where: 

10 

X is the wavelength of the light beam 134; 

d is the distance between the pinhole plate 150 and the surface of the array 

166; 

w is the diameter of a round pinhole 152; and 
15 a is the angle subtended by the dimension w at a radius equal to distance d. 

[0068] In various exemplary embodiments, typical values for these 
parameters of the optical position transducer 100 include: X = 0.6^m, d = 10 cm (10^ 
l^m), and w = 1 mm (10^ |am). As a result, the approximate speckle size D is 60^m. 

[0069] To achieve high resolution, the average speckle size is most usefully 
20 approximately equal to, or slightly larger than, the pixel size of the image elements 

162 of the light detector 160. Moreover, in various embodiments of the readhead 126, 
the average speckle size is approximately two times to ten times the pixel spacing of 
the image elements 162. 

[0070] To acquire an image, the signal generating and processing circuitry 
25 200 outputs a drive signal on the signal line 132 to drive the coherent light source 130 
to emit the coherent light beam 134. The light beam 134 illuminates a portion of the 
optically rough surface 104, which is imaged onto the array 166 of the image elements 
162 of the light detector 160. The signal generating and processing circuitry 200 then 
inputs a pliirality of signal portions over the signal line 164, where each signal portion 
30 corresponds to the image value detected by one or more of the individual image 
elements 162. 
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[0071] To determine a displacement of the optically rough surface 104 
between any two images, the signal portions for a first image received from the light 
detector 1 60 by the signal generating and processing circuitry 200 are stored in 
memory. A short time later, the signal generating and processing circuitry 200 again 
drives the coherent light source 130 and inputs a second image signal from the light 
detector 160 over the signal line 164. Generally, the second image must be generated 
and acquired within a short time period after the first image is acquired, depending on 
the displacement speed of the optically rough surface 104 relative to the light detector 
1 60. The time period must be short enough to insure that the first and second images 
"overlap" sufficiently. That is, the time period must be short enough to insure that a 
pattern of image values present in the first image is also present in the second image, 
so that a significant correlation between the two images can be determined. 

[0072] The first image and the second, or displaced, image are processed to 
generate a correlation function. In practice, the second image is shifted digitally 
relative to the first image over a range of offsets, or spatial translation positions, that 
includes an offset that causes the pattern of the two images to substantially align. The 
correlation function indicates the degree of pattern alignment, and thus indicates the 
amount of offset required to get the two images to align as the images are digitally 
shifted. 

[0073] Figs. 2, 4 and 6 illustrate one exemplary embodiment of the pixel 
structure of a reference image 300 and a displaced image 310 that are obtained by 
moving a surface to be imaged, such as the optically rough surface 104, past an image 
capture system, such as the light detector 160, along a single dimension 304. That is, 
the offset of the displaced image 310 relative to the reference image 300 occurs along 
only a single dimension. As shown in Figs. 2, 4 and 6, each of the reference image 
300 and the displaced image 310 is organized into a plurality of rows 320 and a 
plurality of columns 330. It should be appreciated that there are a number of different 
techniques for comparing the first image to the second image. For example, as shown 
in Fig. 2, in a convention technique, the entire frame of the current second image is 
compared, on a pixel-by-pixel basis, to the entire frame of the first image to generate 
each single correlation value. 

[0074] Thus, as shown in Fig. 2, in a conventional technique, the displaced 
image 3 1 0 is first compared to the reference image 300 at a first offset position. In 
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this offset position, the left and right edges of the displaced image 3 10 are aligned 
with the left and right edges of the reference image 300. At this offset position, a 
correlation function value is determined by comparing each of the pixels 302 of the 
reference image 300 with the corresponding pixel 3 12 of the displaced image 3 10. 

5 Then, the displaced image 3 10 is moved by one pixel along the displacement direction 
304 relative to the reference image 300. Again, for this offset position, each of the 
pixels 312 of the displaced image 310 is compared to the corresponding pixel 302 of 
the reference image 300 for that offset position. The series of correlation values that 
is generated by shifting the second image by one pixel relative to the first image after 

10 each comparison is performed can be plotted as a correlation ftmction, as shown in 
Fig. 3. 

[0075] In the particular example shown in Fig. 2, the displaced image 3 1 0 
has been shifted 6 pixels or offset positions to the left relative to the reference image 
300. Of course, it should be appreciated that the displaced image 3 10 is displaced 

15 both to the left and to the right relative to the reference image 300. It should also be 
appreciated that the displaced image 3 10 continues to be offset relative to the 
reference image 300 only so long as the displaced image 310 overlaps the reference 
image 300 sufficiently that a reasonable accurate correlation ftmction value point is 
likely to be obtained. It should further be appreciated that, for those pixels that lie in 

20 regions of the reference and displaced images that do not overlap with a region of the 
other of the reference and displaced images, those pixels are compared to pixels 
having a default value, or are assigned a default comparison value, or the like. 

[0076] It should be appreciated that, when the entire frame of the current 
reference image is compared to the entire frame of the current displaced image, 

25 cyclical boundary conditions are used. As indicated in Eqs. (2) and (3), the correlation 
value for each row is obtained and the row correlation values are summed. The sum is 
then averaged over the M rows to obtain an average, and noise-reduced, correlation 
function value point. This averaging is desirable to ensure that the correlation 
function value points will be stable to roughly the resolution to be obtained by 

30 interpolating to determine the correlation function extremum. Thus, to obtain roughly 
nanometer resolution by interpolating to determine the correlation function extremum 
when each correlation function value point is offset by approximately 1 jam from 
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adjacent correlation function value points, it is assumed that the correlation function 
value points need to be stable roughly to the desired nanometer resolution value. 

[0077] Fig. 3 is a graph illustrating the results of comparing first and second 
images using the conventional technique shown in Fig. 2 according to the previously- 
described conventional multiplicative correlation function method. As shown in Fig. 
3, the correlation function 400 is created by roughly connecting each of the correlation 
function value points for each offset position. In particular, the correlation function 
400 includes a plurality of discrete correlation function value points 402 that are 
separated along the x-axis by a predetermined offset increment corresponding to the 
pixel pitch P, as indicated by the distance 404. The predetermined offset increment 
can be directly related to a displacement increment of the optically rough surface 104 
shown in Fig. 1. This displacement increment depends upon the effective center-to- 
center spacing between the individual image elements 162 of the array 166 in the 
direction corresponding to the measurement axis 110, which is also referred to as the 
pixel pitch P, in the following description, and the amount of magnification of the 
displacement of the optically diffusing, or optically rough, surface 104 by the optical 
system of the readhead 126. 

[0078] For example, if the effective center-to-center spacing of the image 
elements 162 in the direction corresponding to the measurement axis 1 10 is 10 \im, 
and the optical system of the readhead 126 magnifies the surface displacement by lOx, 
then a 1 |j.m displacement of the illuminated portion of the optically diffusing, or 
optically rough, surface 104 will be magnified into a 10 )xm displacement of the 
speckle pattern on the image elements 162. 

[0079] Each correlation function value point 402 is generated by digitally 
shifting the second image relative to the first image by the effective center-to-center 
spacing of the image elements 1 62 in the direction corresponding to the measurement 
axis 1 10. Because, in this case, the effective center-to-center spacing of the image 
elements 162 corresponds to about a 1 [xm displacement of the optically diffusing, or 
optically rough, surface 104, the discrete correlation function value points 201 will be 
separated by a displacement distance of about 1 nm. 

[0080] As shovra in Fig. 3, the "landscape" of the correlation function 400 
can be divided into two distinct portions, a regular background portion 410 wherein 
the correlation function is substantially flat or regular within a comparatively limited 
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range and a peak portion 420 in which the peak or trough extremum lies and which is 
substantially steeply-sloped and/or exhibits correlation values substantially outside the 
limited range of the background portion. In particular, the regular background portion 
400 has correlation function value points 402 having correlation function values that 
5 lie within the range of an extent 412 which is substantially smaller than the range of 
correlation function values included in the peak portion 420. It should be appreciated 
that, while the extent 412 is often narrow relative to the range of correlation function 
values of the correlation function in various exemplary embodiments described herein, 
the extent 412 need not have any particular relationship relative to the range of 

1 0 correlation function values of the correlation function, so long as the peak portion 420 
can be reliably distinguished from the regular background portion 410. Thus, the 
correlation function deviations of the regular background portion 410 should be easily 
distinguishable from the correlation function peak, but may otherwise in fact be 
significantly uneven in various applications. 

1 5 [0081] In particular, in the regular background portion 410, the correlation 

function value points 402 will have correlation function values that are no more than a 
maximum background value 414 and no less than a minimum background value 416. 
In contrast, for peak-type correlation function values, substantially all of the 
correlation function value points 402 that lie within the peak portion 420 have 

20 correlation function values that are significantly greater than the maximum 

background value 414. Similarly, for trough-type correlation function values, 
substantially all of the correlation function value points 402 that lie within the peak 
portion 420 have correlation function values that are significantly less than the 
minimum background value 416. 

25 [0082] In general, the correlation function value points 402 lying within the 

correlation function peak portion 420 will usually be substantially equally distributed 
on either side of the actual correlation function peak 422 that represents the offset 
position where the two images most nearly align. Thus, the actual correlation function 
peak 422 lies generally at or near the center of a width 424 of the correlation function 

30 peak portion 420. 

[0083] However, as outlined above, in this conventional technique, 
significant amounts of system resources must be provided to determine each pixel-to- 
pixel correlation value, to accumulate those correlation values for every pixel-to-pixel 
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comparison for every pixel in the first image, to apply the appropriate scaling 
reference, and to perform this for every potential correlation function value point 402. 
This is especially true when the second image can move in at least two orthogonal 
directions relative to the first image. In this case, not only must a single full frame 
comparison be performed for every possible offset for each of the m columns that lie 
along the row dimension, but must also be performed, for each offset of the m 
columns, for each possible offset of the n rows that lie along the column dimension. 

[0084] Thus, in this conventional technique, for a one-dimensional 
displacement, when the first image and the second image each comprises M x N 
pixels arranged in a two-dimensional array of M rows of pixels and N columns of 
pixels, one common correlation algorithm is: 



R(p) is the correlation function value for the current offset value; 
p is the current offset value, in pixels; 
m is the current column; 
n is the current row; 

Ii is the image value for the current pixel in the first image; and 

h is the image value for the second image. 
In this conventional technique, p can vary from -N to +N in one-pixel increments. 
Usually, however, the range of p is limited to -N/2 to N/2, -N/3 to N/3, or the like. 

[0085] For a two-dimensional displacement, when the current reference 
image and the current displaced image each comprises M x N pixels arranged in a 
two-dimensional array of M rows of pixels and N columns of pixels, one common 
correlation algorithm is: 





(3) 



where: 
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R(p,q) is the correlation function value for the current offset values in each of 
the two dimensions; 

p is the current offset value, in pixels, along the first dimension; 
q is the current offset value, in pixels, along the second dimension; 
5 m is the current column; 

n is the current row; 

11 is the image value for the current pixel in the first image; and 

12 is the image value for the second image. 

Similarly, in this conventional technique, q can vary from -M to +M in one-pixel 
10 increments. Usually, however, the range of q is limited to -M/2 to M/2, -M/3 to M/3, 
or the like. 

[0086] As a result, this conventional technique would require determining 
the correlation value for up to 2M correlation function value points for a one- 
dimensional displacement and up to 2M x 2N correlation function value points for a 

15 system that allows displacements in two dimensions. Thus, in one-dimensional 

displacements, and even more so in two-dimensional displacements, the conventional 
full frame analysis consumes too large an amount of system resources. As a result, the 
full frame correlation requires a system having either significant processing power, a 
high speed processor, or both. Otherwise, it becomes impossible to perform the full 

20 frame correlation function peak location process in real time. 

[0087] However, as outlined in the incorporated 671 application, in general, 
only a few points near the extremum of the peak portion 420 of the correlation 
function 400 are used in determining the actual position offset, even when doing so to 
a very high accuracy by interpolation. Thus, some of the correlation function value 

25 points 402 that lie on the correlation function peak 420 are not used in determining the 
offset position, and none of the correlation function value points 402 that lie within 
the background portion 410 are so used. 

[0088] The inventor has thus determined that it is generally only necessary 
to roughly determine the location of the correlation function peak 422 by locating a 

30 correlation function value point 402 that lies within the correlation function peak 

portion 420 before it becomes desirable determine the full correlation function value 
for each correlation function value point that is close to the peak 422 of the correlation 
function 400. The inventor has further determined that such a correlation function 
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value point 402 that lies within the correlation function peak portion 420 can be 
identified by sparsely searching the correlation function 400 by determining the 
correlation function values for one or more correlation function value points 402 that 
are sparsely distributed in the correlation function 400. 

[0089] As pointed out above, often only a few correlation function value 
points 402 around the peak 422 are used to determine the offset position of the true 
peak of the correlation function 400. The inventor has thus determined that it may be 
possible to use only some of those correlation function value points 402 of the sparse 
set that lie within the peak portion 420 of the correlation function 400 to determine the 
offset position of the peak 422. That is, the offset position of the peak 422 can be 
determined without having to determine the correlation function value for each 
correlation function value point 402 that is close to the peak 422 of the correlation 
function 400. 

[0090] The inventor has also determined that, for the high-spatial-frequency 
images to which the sparse set of correlation function value points technique used in 
the systems and methods according to this invention are particularly effective, there 
will generally be some a priori knowledge about the average value of the extent 412 of 
the regular background portion 410 and the approximate values for the maximum 
background value 414 and the minimum backgrotind value 416. 

[0091] For example, in the speckle-image-based optical position transducer 
100 shown in Fig. 1, the optically rough surface 104 will produce such high-spatial- 
frequency images. When such high-spatial-frequency speckle images are used as the 
reference and displaced images discussed above, for any given optically rough surface 
104, the maximum background value 414 and/or the minimum background value 416 
of the background portion 412 are very stable and can be determined during 
manufacture of the speckle-image-based optical position transducer 100. As a result, 
depending on the type of correlation function used, the maximum background value 
414 or the minimum background value 416 can be stored in the signal generating and 
processing circuitry 200 and used as a threshold value. In practice, in the speckle 
image-based position transducer 100, to eliminate the dependence of R(p,q) on laser 
intensity, R(p,q) is often normalized relative to the average value of the image 
intensity. Thus, in these situations, the value of the correlation function is actually the 
normalized value of the correlation function. 
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[0092] That is, the signal processing and generating circuit 200 has a priori 
knowledge about the correlation function background value 414 or 416 that the 
correlation function value points in the peak portion 420 must either exceed or lie 
below, respectively. As a result, a simple comparison to that a priori value can be 
5 used to quickly determine the general location of the peak portion 420 by finding any 
single correlation function value point having a correlation function value that either 
lies above the maximum backgroimd value 414 or that lies below the minimum 
background value 416. 

[0093] The inventor has further discovered that the width 424 of the peak 

1 0 portion 420 for such high-spatial-frequency images is generally narrow relative to the 
full extent of the correlation function domain. The inventor has further discovered 
that the correlation function values for correlation function value points 402 at the 
edge of the peak portion 420 sharply depart from the average correlation function 
value of the correlation function value points 402 that lie within the regular 

15 background portion 410. That is, in general, until immediately around the actual 
correlation function peak 422, such high-spatial-frequency images are no more 
correlated at positions near the peak portion 420 than at positions that are far from the 
peak portion 420. In contrast, non-high-spatial-frequency images, such as those used 
in the sparse techniques disclosed in Musmann, have very broad and shallow 

20 correlation function value peaks. That is, the techniques disclosed in Musmann 

operate only because the correlation function at all points has a gradient that points 
toward the location of the correlation function peak. 

[0094] In certain situations, there may not be any a priori knowledge 
available about particular images to be used as the reference and displaced images 300 

25 and 310. However, the inventor has further determined that, even if such a priori 
knowledge is not available, such a priori knowledge can be readily be derived any 
time the correlation function 400 is determined. That is, in general, for most high- 
spatial-frequency images, the average value of the backgroimd portion 410, and the 
extent 412, the maximum background value 414 and the minimum backgroimd value 

30 4 1 6 of the regular background portion 410 are substantially stable, especially in 
comparison to the correlation flmction values that will be obtained for correlation 
function value points 402 that lie within the peak portion 420. 
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[0095] Thus, these values can be derived from a fully defined correlation 
function obtained by conventionally comparing a displaced image to a reference 
image. These values can also be derived by comparing a given image to itself, i.e., 
auto-correlating that image. Additionally, for the same reasons as outlined above, it 
5 should be appreciated that the width of the peak portion of the auto-correlation 
fiinction, which is by definition at the zero-offset position, can be determined by 
determining the correlation function values for at least a subset of the correlation 
function value points near the zero-offset position, without having to determine the 
correlation function values for correlation function value points distant from the zero- 

1 0 offset position. Similarly, for the same reasons as outlined above with respect to Fig. 
8, it should be appreciated that less than all of the pixels of the image can be used in 
generating the correlation function values for the auto-correlation function. 

[0096] In a first exemplary technique according to this invention, as shovm 
in Figs. 4 and 5, in place of the conventional image correlation function peak location 

1 5 process outlined with respect to Figs. 2 and 3, locating the peak of the image 

correlation function is performed as a two (or more) step process. In particular, as 
shown in Fig. 4, rather than comparing the displaced image 3 10 to the reference image 
300 for every column 330, the displaced image 310 is compared to the reference 
image 300 only at selected columns 332 that are displaced from each other. 

20 [0097] For example, in the exemplary embodiment shown in Fig. 4, the 

displaced image 3 10 is currently being compared to the reference image 300 at an 
offset position that corresponds to the column 332-2. In a previous comparison, the 
displaced image 310 was compared to the reference image 300 at an offset position 
that corresponded to the colunm 332-1 that is spaced apart from the current column 

25 332-2 by one or more skipped columns 332. Likewise, a next comparison of the 

displaced image 3 10 to the reference image 300 will take place at a column 332-3 that 
is spaced apart from the current column 332-2 by one or more skipped columns 332. 

[0098] That is, in a first step, for a number of sparsely-located offset 
positions, all of the rows of the displaced image are compared in full to the 

30 corresponding rows of the reference image to a generate correlation value. Thus, a 
sparse series of such correlation values, i.e., the sparse set of the correlation function 
value points 402, corresponding to those shown in Fig. 5, is generated by shifting the 
displaced image 310 relative to the reference image 300, after each comparison is 
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performed, by either a predetermined number of pixels or by a dynamically- 
determined number of pixels, or to a next location in a sequence of predetermined 
offset locations or to a next dynamically determined offset location. 

[0099] Next, in a first exemplary embodiment of the sparse searching 
technique according to this invention, the sparse set of the correlation function value 
points 402 determined in the first stage are analyzed to identify those correlation 
function value points 402 of the sparse set that lie outside of the extent 412 of the 
correlation function values of the background portion 410, i.e., to identify those 
correlation function value points 402 of the sparse set that lie within the peak portion 
420 of the correlation function 400. As outlined above, in the high-spatial-frequency 
images used with the systems and methods of this invention, such as those of the 
optically rough surface 104, the correlation function value points 402 in the regular 
background portion 410 of the correlation function, i.e., those points 402 that do not 
lie in the peak portion 420, have values that range only slightly away from an average 
value of the regular background portion 410. That is, the values of the correlation 
function value points in the regular background portion 410 will not be greater than 
the maximum background value 414 or will not be less than the minimum background 
value 416. 

[0100] Thus, by comparing the image value of each correlation function 
value point 402 in the set of sparsely located correlation function value points shown 
in Fig. 5 with either the minimum background value 416 or the maximum background 
value 414, the correlation function value points 402 of the sparse set can readily be 
classified as part of the background portion 4 1 0 or as part of the peak portion 420. As 
a result of identifying one or more of the correlation function value points 402 of the 
sparse set of correlation function value points 402 that lie within the peak portion 420, 
the peak portion 420, and thus the correlation function peak or trough, can be 
approximately located. 

[0101] Alternatively, in a second exemplary embodiment of the sparse 
searching technique according to this invention, the sparse set of the correlation 
function value points 402 determined in the first stage are analyzed to identify those 
pairs of adjacent ones of the correlation function value points 402 of the sparse set 
that have a slope that is greater than a threshold slope. That is, as shown in Figs. 3, 5 
and 7-10, the absolute values of the slopes of the correlation function defined between 
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adjacent correlation function value points 402 that lie within the background portion 
410 are significantly less than the absolute values of the slopes between most pairs of 
adjacent correlation function value points that have at least one of the pair lying 
within the peak portion 420. 
5 [0102] Thus, a maximum absolute value of the slope between any set of two 

correlation function value points that both lie within the background portion can be 
determined as the threshold slope. Then, for any pair of adjacent correlation function 
value points of the sparse set, a sparse slope of the correlation function between those 
two sparse correlation function value points can be determined. The absolute value of 

1 0 that slope can then be compared to the threshold slope. If the absolute value of the 
sparse slope is greater than the threshold slope, at least one of the pair of adjacent 
correlation function value points lies within the peak portion 420. 

[0103] Alternatively, a maximum positive-valued slope and a maximum 
negative-valued slope can similarly be determined as a pair of threshold slopes. Then, 

1 5 the value of the sparse slope can be compared to the pair of threshold slopes. Then, if 
the sparse slope is more positive than the positive-valued slope, or more negative than 
the negative- valued slope, at least one of the pair of adjacent correlation function 
value points lies within the peak portion 420. 

[0104] Of course, it should be appreciated that the absolute value of the 

20 slope for a pair of adjacent correlation function value points can be less than or equal 
to the absolute value, or the slope can be between the maximum positive-valued and 
negative-valued slopes, while both of the pair of correlation function value points lie 
within the peak portion 420. To prevent this from adversely affecting the sparse 
search techniques discussed above, some or all of the pairs of adjacent ones of the 

25 sparse set of correlation fiinction value points are analyzed in various exemplary 

embodiments. It should further be appreciated that the threshold slope or slopes, like 
the average, minimum and/or maximum values of the background portion 410 can be 
predetermined or determined from an auto-correlation function or from a correlation 
function for a set of representative images. 

30 [0105] Then, in the second step, based on the approximately determined 

location of the peak portion 420, the first and second images will be compared at 
surrounding locations in the correlation space, i.e., at offset positions that will lie 
within the peak portion 420, to generate the correlation values for all of, or at least a 
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sufficient number of, the correlation function value points 402 that lie within the 
approximately determined peak portion 420. In particular, the second step will often 
unequivocally determine the pixel displacement that corresponds to the peak 
correlation value, because the sparse search has missed it only by one or a few pixels. 
It should be appreciated that, as discussed in the incorporated 761 application, only 
the correlation values that are around the actual correlation peak 422 are used to 
determine the interpolated sub-pixel displacement. Thus, only arovmd the 
approximately-determined correlation peak or trough 422 do an additional number of 
the correlation function value points 402 need to be determined. 

[0106] In the particular exemplary embodiment shown in Figs. 4 and 5, in 
comparison to the exemplary embodiment shown in Figs. 2 and 3, only every third 
offset position is used to determine a correlation function value point 402. As shown 
in Fig. 5, as a result, only four correlation function value points 402a-402d of the 
sparse set of correlation function value points 402 lie within the width 424 of the 
correlation function peak portion 420. However, only M/3 (or fewer) correlation 
function value points 402 were determined to locate the peak portion 420, compared 
to M such points in the conventional technique shown in Figs. 2 and 3. Of course, an 
even more sparsely distributed set of offset positions could be used. 

[0107] In particular, a correlation function value point 402b has a correlation 
function value that is farthest from the average value of the background portion 410. 
This correlation fimction value point 402b is bracketed by a pair of correlation 
function value points 402a and 402c that also lie in the correlation function peak 
portion 420 but which have correlation function values that are closer to the average 
value of the background portion 410. Accordingly, the actual correlation function 
peak 422 must lie somewhere between the first and third correlation function value 
points 402a and 402c. 

[0108] Thus, it is only necessary to determine a correlation function value 
point for those additional higher-resolution offset positions that lie between the offset 
positions corresponding to the first and third correlation function value points 402a 
and 402c. Moreover, depending on the particular technique used to interpolate 
between the full set of correlation function value points 402, or to fit a curve to the 
full set of correlation function value points 402, it may be necessary only to determine 
those correlation function value points for offsets that are close to the correlation 
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function value point 402b, such as, for example, within two or three of the higher 
resolution offset steps from the correlation function value point 402b. 

[0109] In the exemplary embodiment shown in Fig. 5, as outlined above, the 
sparse set of correlation function value points is created by determining a correlation 
5 function value for every third offset position. That is, in the exemplary embodiment 
shown in Fig. 5, the sparse set of correlation function value points has been generated 
by skipping a predetermined number of offset positions or pixels. 

[0110] In general, as outlined above, for the high-spatial-frequency images 
to which the systems and methods of this invention are particularly applicable, the 

1 0 average value of the background portion 410, the maximum and minimum values 414 
and 416 of the background portion 410 and/or the width 424 and the approximate 
height of the peak portion 420 can be known a priori for systems that image a known 
object. Such situations include imaging the optically rough surface 104 in the 
speckle-image-based optical position transducer system 100 shown in Fig. 1. 

1 5 [0111] In these situations, because the width 424 of the peak portion 420 is 

known, the predetermined number of, i.e., the spacing of, the correlation function 
value points 402 to be included in the sparse set of the correlation function value 
points 402 can be selected such that at least one of the sparse set of correlation 
function value points 402 is guaranteed to fall within the width 424 of the peak 

20 portion 420 regardless of its position in any particular correlation fiinction 400. 

However, it should be appreciated that it may be more desirable to have the sparse set 
of correlation function value points include sufficient numbers of correlation function 
value points 402 (and thus have a smaller spacing) such that a desired number, such as 
two or more, of the correlation function value points 402 of the sparse set are 

25 guaranteed to fall within the width 424 of the peak portion 420. 

[0112] However, as outlined above, the sparse set of correlation function 
value points 402 can be created in alternative exemplary embodiments by dynamically 
determining the nvmiber of correlation function value points 402 (and thus the spacing 
between pairs of adjacent ones of the correlation fimction value points 402) to be 

30 included in the sparse set, and using that number to govern a predetermined sequence 
of correlation function value points 402 to be determined in sequence order, or by 
dynamically determining the sequence of correlation function value points 402 to be 
determined in sequence order. It should also be appreciated that, when dynamically 
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determining the number of correlation function value points 402 to be included in the 
sparse set (which implicitly determines the spacing and vice versa), the sparse set can 
be dynamically determined for each correlation event, such as in dynamically 
determining the sparse set view of the previous offset determined in a previous 
5 correlation event, or can be dynamically determined based on changes to the base 
image used in the correlation process. The sparse set of points can be dynamically 
determined during a set-up or calibration mode prior to normal operation, or in near 
real-time or real-time during normal operation in various embodiments. 

[0113] Moreover, since any correlation function value point having a 

1 0 correlation function value that lies outside the extent 412 of the background portion 
410 will identify the location of the correlation function peak portion 420, in various 
exemplary embodiments, determining the correlation function values for correlation 
function value points that are spaced by more than the peak width 424 firom a first 
determined one of the sparse set of correlation function value points that lies within 

1 5 the peak portion 420 can be omitted. As a result, it becomes possible to further reduce 
the sparse set of correlation function value points 402 by skipping those correlation 
function value points 402 of the sparse set of correlation fimction value points 402 
that have not been analyzed once the width of the correlation function peak portion 
420 has been traversed. 

20 [0114] That is, once a correlation function value point having a correlation 

function value that is greater than the maximum background value 414 for a positive- 
going extremum or less than the minimum background value 416 for a negative-going 
extremum of the background portion 410 is identified, the approximate location of the 
peak portion 420 has been located. Furthermore, as outlined above, the width 424 of 

25 the peak portion 420 is, in many applications, very narrow relative to the range of the 
correlation function 400. As a result, as outlined above, once the approximate 
location of the peak portion 420 has been identified, determining the correlation 
function value for any correlation fimction value points 402 that are more than the 
width 424 of the peak portion 420 away from that correlation function value point 402 

30 in the peak portion 420 is essentially useless. 

[0115] In yet another variation of the first exemplary embodiment outlined 
above with respect to Figs. 4 and 5, a "binary" sequencing of the correlation function 
value points included in the sparse set of correlation function value points to be 
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determined that takes advantage of this result can be used. This is one type of 
predetermined sequence for the sparse set of the correlation function value points 402. 
The correlation function space can be searched using a binary search technique by 
initially determining the correlation function value for correlation function value 
points 402 at each extreme offset position and for an offset position that lies 
approximately halfway between the extreme offset positions. If none of these 
correlation function value points 402 lie within the peak portion 420, then additional 
correlation function value points 402 that lie approximately halfway between each 
pair of adjacent previously-determined correlation function value points can be 
determined. This can then be repeated until a correlation function value point lying in 
the peak portion 420 is identified. Importantly, this iterative process does not need to 
continue after at least one such correlation function value point 402 is identified. 

[0116] Thus, for the first iteration, for a correlation function 400 that has a 
first extreme offset position at a position -L and a second extreme position at an offset 
position of +L, where L is generally related to the image frame dimension, the 
correlation function values are determined for correlation function value points 402 
having offset values of -L, +L and 0. Then, in a second iteration, the correlation 
function values for correlation function value points having offset values of -L/2 and 
+L/2 are determined. Then, in a third iteration, the correlation function values for 
correlation function value points 402 having offset values of -3L/4, -L/4, +L/4 and 
+3L/4 are determined. This continues until the correlation function values for the 
entire sparse set of correlation function value points 402 are determined or, more 
likely, the location of the peak portion 420 is identified. Of course, it should be 
appreciated that, during any particular iteration, if one of the correlation function 
value points 402 to be determined in that iteration lies within the peak portion 420, 
any other correlation flmction value points 402 of that iteration that are more than the 
width 424 of the peak portion 420 away from that correlation function value point 402 
do not need to have their correlation function values determined. 

[0117] In this particular variation, once the approximate location of the peak 
portion 420 is identified using this binary search, the second stage is performed, where 
the correlation function values for each of the correlation function value points 402 
that may lie in the peak portion 420 are determined. Alternatively, in a variation of 
the second step, because only a single correlation function value point lying within the 
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peak portion is normally identified using this binary search technique, in a second 
stage of this variation, a regularly spaced sparse set of correlation function value 
points distributed around that correlation function value point 402 that lies within the 
peak portion 420 can be determined to more precisely locate the peak portion 420. 
5 [0118] Then, in a third stage, as outlined above with respect to the second 

stage discussed in the previously-described first exemplary embodiment, the furthest 
correlation function value point 402b and the adjacent correlation function value 
points 402a and 402c within the peak portion 420 can be identified from this sparse 
set of correlation function value points determined in the second step. Then, at least 

1 0 some of the correlation function value points lying adjacent to the farthest correlation 
function value point 402b and between the correlation function value points 402a and 
402c can be determined to provide the correlation function value points 402 necessary 
to perform the particular interpolation technique used. 

[0119] In yet another exemplary variation of the sparse set technique 

15 outlined above with respect to Figs. 4 and 5, rather than using a single sparse set, in a 
first stage, a first extremely sparse set of correlation fonction value points that may 
have a spacing, for example, greater than the width 424 of the peak portion 420 can be 
used. Then, if none of the correlation function value points of this extremely sparse 
set lie within the peak portion 420, in a second stage, the extremely spares set can be 

20 offset by a determined amount ,or a second, less extremely sparse set of correlation 
function value points 402 can be used. Then, if the peak portion 420 is not located, 
subsequent iterations using third, fourth, etc., continually less offset, or less sparse, 
sets can be determined until the peak portion 420 is located. 

[0120] Once the peak portion 420 is located, any subsequent less sparse sets 

25 can be omitted, as can be the rest of the correlation function value points of the current 
sparse set. Then, a final stage corresponding to the second stage outlined above with 
respect to the first exemplary embodiment described relative to Figs. 4 and 5 can be 
performed to provide the correlation function value points 402 usable to determine the 
actual location of the correlation fimction peak 402. In particular, it should be 

30 appreciated that this variation is essentially similar to the binary search variation, 

except that the location of the correlation function value points 402 in each sparse set 
is not precisely dictated relative to the extreme offset positions as in the binary search 
variation. 
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[0121] Figs. 6 and 7 illustrate a second exemplary embodiment of the sparse 
set of image correlation function value points comparison technique according to this 
invention. In particular, with respect to the second exemplary embodiment illustrated 
in Figs. 6 and 7, the inventor has determined that, for the high-spatial-frequency 
5 images to which the systems and methods of this invention are particularly suited, it is 
possible to use less than all of the pixels when determining the correlation function 
value for any particular correlation function value point 402 without effectively 
altering the functional relationships between the normalized background portion 410 
and the normalized peak portion 420 of the correlation function 400. 

1 0 [0122] That is, like the correlation function 400 shown in Fig. 4, the 

correlation function 500 shown in Fig. 7 has a regular background portion 500 having 
correlation function value points 502, in eluding points 502a-502d, having correlation 
function values that lie within a range of an extent 512 which is substantially smaller 
that the range of correlation function values included in the peak portion 520. The 

1 5 extent 5 1 2 is defined by a maximum background value 514 and a minimum 

background value 516. Similarly, the correlation function 500 has a peak portion 520 
that has a generally narrow width 524 relative to the domain of the correlation 
function 500. In fact, except for the range of correlation function values over which 
the correlation function 500 extends, the general shape of the correlation function 500 

20 is more or less indistinguishable from the shape of the correlation function 400. Thus, 
in some exemplary embodiment of this second exemplary embodiment, as shown in 
Fig. 6, rather than comparing every pixel of every row M in the displaced image 310 
to the corresponding row and pixel in the reference image 300 to determine the 
correlation function value point 402, only a few rows M, and, at an extreme, only one 

25 row M, will be compared to determine the correlation function value for a particular 
function value point 502. 

[[0123] Fig. 8 illustrates various different correlation functions 400, 500, 500' 
and 500" obtained by using different amounts of the pixels of the reference and 
displaced images 300 and 310 when determining the correlation function values for 

30 the correlation function value points 402 and 502. It shoxild be appreciated that the 
correlation functions 400, 500, 500' and 500" shown in Fig. 8 are average difference 
correlation functions, in contrast to the multiplicative correlation functions shown in 
Figs. 3, 5 and 7. In particular, as shovm in Fig. 8, as the number of rows of pixels that 
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are used to determine the correlation function values gets progressively smaller for the 
correlation fimctions 500, 500' and 500", both the average value of the background 
portions 510 and the difference between the values in the background portions 510 
and the extreme value of the correlation function value points 502 lying in the peak 
5 portions 520 gets smaller. 

[0124] At the same time, the noise in the background portions 510, i.e., the 
extents 512 between the corresponding maximum background values 514 and 
minimum background values 516, increases. In this exemplary embodiment, the 
signal is the difference of the extreme value of the correlation function value points 

1 0 lying in the peak portions 520 from the average value of the corresponding 

background portions 510. It should be appreciated that, because both the noise 
increases as the number of rows decreases and the difference between the extreme 
value of the peak portions 520 and the average value of the corresponding background 
portions 510 decreases, the signal to noise ratio decreases even more rapidly. 

1 5 [0125] However, as shown in Fig. 8, the relative widths 524 of the peak 

portions 520 in terms of the pixel spacing does not substantially change. In fact, in 
general, the width 524 of the peak portion 520, i.e., the offset difference between the 
correlation function value points that are closest to but outside of the extent 512, will 
generally shrink, rather than increase, because of the greater noise. That is, i.e., 

20 extents 5 12 which are larger due to additional noise of the background portions 510, 
will encompass some correlation function value points 502 that would have been 
determined to be part of the peak portion 420 in the less noisy first exemplary 
embodiment. 

[0126] It should also be appreciated that any of the various techniques 
25 outlined above for determining the number of correlation function value points 402 to 
be included in the sparse set of correlation function value points 402 can be combined 
with the technique for limiting the number of image pixels to be compared for a 
correlation function value of this second exemplary embodiment. Thus, it becomes 
possible to reduce even further the amount of system resources and processor time and 
30 power necessary to determine each correlation function value for each correlation 

function value point 502 included in the sparse set of correlation function value points 
502. 
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[0127] For example, in various exemplary embodiments, because only a 
small number of rows is compared, each comparison can be quickly generated. 
However, because only a small number of rows, rather than the entire image, is used, 
the correlation value obtained for each correlation function point only approximates 
5 the correlation value that would be obtained from comparing all of the rows of the 
second image to the corresponding rows of the first image for each such correlation 
point. Nonetheless, the approximate correlation values will still be able to indicate the 
approximate location of the peak portion 520. Because fewer, and in some 
circumstances, significantly fewer, pixels are used in determining the correlation 
1 0 fimction value for the correlation function value points 502 in the sparse set of 

correlation fianction value points 502, the amount of system resources consumed in 
locating the approximate position of the peak portion 520 is reduced, sometimes 
significantly. 

[0128] Fig. 9 is a graph of a conventional correlation fimction 600 obtained 
15 by correlating the displaced and reference images 310 and 300, where the displaced 

image 3 1 0 can be displaced in two dimensions relative to the reference image 300. In 
particular, as shown in Fig. 9, the correlation fiinction 600 extends in two dimensions, 
in contrast to the one-dimensional correlation functions show in Figs. 3, 5 and 7. In 
particular, for the conventional two-dimensional correlation fimction 600 shovm in 
20 Fig. 9, a very dense set of correlation function points 602 is determined for the 
conventional two-dimensional correlation function 600. Accordingly, while the 
location of the peak portion 620 of the two-dimensional correlation function 600, and 
the location of the correlation fimction peak (in this case, trough) 622 can be very 
accurately determined, the system resources consvmied in determining this very dense 
25 set of correlation function value points 602 makes it difficult, if not impossible, to 

determine the correlation fimction 600 in real time even if high speed data processors 
are used. 

[0129] Accordingly, as shown in Fig. 1 0, if a sparse set of correlation 
function value points 606, selected from the set of all correlation function value points 
30 602 of the correlation function 600, is used according to the first exemplary 

embodiment outlined above with respect to the one-dimensional correlation fimctions 
400 and 500, the amount of systems resources consumed in determining this two- 
dimensional sparse set of correlation fimction value points 606 is considerably 
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reduced. As shown in Fig. 10, in one exemplary embodiment, the sparse set of 
correlation function value points 606 can be regularly distributed, for example, as a 
grid, across the two-dimensional correlation function 600 to ensure that at least one of 
the sparse set 606 of the correlation function value points 602 lies within the narrow 
5 peak portion 620. It should be appreciated that only a portion of the grid of sparsely 
distributed correlation function value points 606 are labeled in Fig. 10. However, it 
should be appreciated that the sparse set of correlation function value points 606 can 
be distributed in any desired marmer within the two-dimensional correlation function 
600. 

1 0 [0130] In particular, the sparse set of correlation function value points 606 

can be decomposed into various subsets of correlation function value points 602 that 
are searched in order as outlined above with respect to the multilevel search variation 
discussed with respect to the first exemplary embodiment. Similarly, in another 
exemplary variation, a two-dimensional binary search technique, similar to the one- 

1 5 dimensional binary search technique discussed above, could be used. 

[0131] Finally, it should be appreciated that, as in the second exemplary 
embodiment outlined above, only a subset of the pixels of the reference and displaced 
images can be compared, rather than comparing all of the pixels of the reference and 
displaced images. As outlined above with respect to the second exemplary 

20 embodiment, this would allow a further significant reduction in the amount of systems 
resources needed to determine each correlation function value. 

[0132] As outlined above, after determining and analyzing the correlation 
function values for each of the first or multiple stages of the sparse sets of correlation 
function value points 606, once the peak portion 620 of the two-dimensional 

25 correlation function 600 is located, one or more stages of less sparse sets of 

correlation function value points can be determined, culminating in a full set of 
correlation function value points to be used in determining the location of the 
correlation function peak using the techniques outlined in the '671 application. Of 
course, it should be appreciated that, once the location of the peak portion of the two- 

30 dimensional correlation function is located, the full set of correlation function value 
points can be used as the only stage in determining the position of the actual 
correlation function value peak using the techniques outlined in the '671 application. 
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[0133] It should particularly be appreciated that, since the sparse set of 
correlation function value points 606 used to identify the location of the peak portion 
620 of the two-dimensional correlation function 600 is sparse in two dimensions, the 
ratio of the correlation function value points 606 included in the sparse set, relative to 
5 the number of the correlation function value points 602 in the entire correlation 

function 600, is extremely small. Thus, a significant reduction in the system resources 
necessary to search through the two-dimensional correlation function 600 can be 
obtained, even relative to the reduction in system resources necessary to determine the 
correlation functions for the sparse set of correlation functions 402 for the one- 

10 dimensional correlation functions shovra in Figs. 5 and 7. 

[0134] It should be appreciated that, for a two-dimensional correlation 
function, the points 606 within the peak portion 620, which correspond to the first and 
third correlation function value points 402a and 402c discussed above, may not lie on 
opposite sides of a furthest correlation function value point 606 within the peak 

1 5 portion 620. Thus, for a two-dimensional correlation function, those first and third 
correlation function value points 606 can be used to define a range of offset positions 
extending in all directions from the furthest correlation function value point606 in the 
two-dimensional correlation function. Similarly, this same technique could be used to 
determine a range around a correlation function value point 402b in a one-dimensional 

20 offset situation. Then, at least some of the correlation function value points 606 (or 
402) within that range are used to determine the offset position of the correlation 
function peak. 

[0135] Fig. 1 1 shows a flowchart outlining a first exemplary embodiment of 
a method for using a sparse set of image correlation function value points locations in 
25 the correlation function space to locate a peak or trough to a first resolution according 
to this invention. As shovm in Fig. 11, operation begins in step SI 00 and continues to 
step S200, where the reference image is captured. Then, in step S300, the displaced 
image is captured. It should be appreciated that the displaced image is displaced by 
some imknown offset relative to the reference image, but overlaps the reference 
30 image. Operation then continues to step S400. 

[0136] In step S400, the reference and displaced images are compared for a 
plurality of sparsely distributed offset positions, i.e., offset positions that correspond 
to a sparse set of correlation fiinction value points according to any of the sparse set 
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constructions or procedures previously discussed. For example, in this first exemplary 
embodiment, in step S400, the sparse set of correlation function value points is either 
predetermined, or corresponds to a predetermined sequence of correlation function 
value points to be determined. Operation then continues to step S500. 
5 [0137] In step S500, the correlation function value points of the sparse set of 

correlation function value points are analyzed to identify one or more of the 
correlation function value points of the sparse set that lie within a peak portion of the 
correlation function. As outlined above, the correlation function value points of the 
sparse set that lie within the peak portion can be determined by comparing the 

1 0 correlation function values of the correlation function value points of the sparse set 
with a previously-determined characteristic of the extent of the regular background 
portion, such as an average value, a previously-determined maximum value, or a 
previously-determined minimum value. Whether the minimum or maximum value is 
used will depend on the type of mathematical function used to obtain the correlation 

1 5 function values. 

[0138] Then, once the peak portion is determined in step S500, in step S600, 
a higher-resolution set, such as a full set, of correlation function value points for at 
least a portion of the offset positions that lie within the approximately determined 
peak portion are determined. That is, as outlined above, the full portion corresponds 

20 to a number of adjacent offset positions spaced apart at the pixel pitch. However, it 
should be appreciated that not all of the offset positions that lie within the peak 
portion need to be determined. Next, in step S700, the correlation function values for 
at least some of the full set of correlation function value points determined in step 
S600 are used to determine the actual displacement or offset between the reference 

25 and displaced images. It should be appreciated that any of the various techniques set 
forth in the incorporated 671 application can be used in step S700. Operation then 
continues to step S800. 

[0139] In step S800, a determination is made whether operation of the 
method is to stop, or whether additional displacements will need to be determined. If 

30 additional displacements will need to be determined, operation jumps back to step 

S300 to capture a subsequent displaced image. Otherwise, operation continues to step 
S900, where operation of the method halts. 
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[0140] It should be appreciated that, for position transducers, such as the 
speckle-image-based optical transducer 100 shown in Fig. 1, in many applications the 
displaced image captured in step S300 will eventually be displaced beyond the frame 
of the reference image S200. In this case, the various techniques disclosed in U.S. 
5 Patent Application No. 09/860,636, incorporated herein by reference in its entirety, 
can be used between steps S800 and S300 to provide for new reference images. In 
particular, a previously-obtained displaced image could be used as the next reference 
image. 

[0141] Fig. 12 shows a flowchart outlining a second exemplary embodiment 

10 of the method for using a sparse set of image correlation function value points 
locations in the correlation function space to locate a peak or trough to a first 
resolution according to this invention. The steps SI 00- S3 00 of Fig. 12 and Fig. 1 1 are 
similar. Regarding the steps S400 and 85 00, however, in the exemplary embodiments 
outlined in Fig. 1 1, the correlation function values for all of the correlation function 

1 5 value points of the sparse set are determined in step S400. Then, all of the determined 
sparse correlation function values are analyzed in step S500. In contrast, as shovm in 
Fig. 12, the steps S400 and 85 00 are modified such that the correlation function value 
for one sparse correlation function value point can be determined in S400 and 
analyzed in step 8500, before the correlation function value for a next sparse 

20 correlation function value point is determined in step 8400. In this case, as shown in 
Fig. 12, after step 8500, but before step 8600, a determination is made in an added 
step 8550 whether, in view of the current correlation function value point, the location 
of the peak portion has been sufficiently identified. If not, operation returns to step 
S400 for analysis of the next correlation function value point of the sparse set. If so, 

25 operation continues to step S600, where the higher-resolution set of correlation 

function value points to be determined for locating the correlation function peak offset 
position is determined, and then to step 8700, where the determined higher-resolution 
set is analyzed, similarly to the steps 8600 and 8700 of Fig. 11. 

[0142] It should further be appreciated that, in various variations of step 

30 S550, operation continues to return to step 8400 until a first correlation function value 
point in the peak portion is found, until a predetermined number of correlation 
function value points in the peak portion are found, until the correlation flinction value 
points of the sparse set that lie within the peak width of the peak portion to either side 
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of the first correlation function value point to be determined as lying within the peak 
portion have also been determined, or until the width of the peak portion 420 has been 
spanned. Thus, in various variations of step S550, a plurality of the correlation 
function value points of the sparse set that could potentially lie within the peak portion 
5 are determined before operation continues to step S600. This is advantageous when 
determining the particular correlation function value points to be included in the 
higher-resolution set of such points determined and analyzed in step S600. 

[0143] It should be appreciated that the flowcharts outlined above in Figs. 
1 1 and 12 can also be modified to incorporate any of the various variations outlined 

10 above with respect to Figs. 5-8 to allow for multiple instances of steps S400 and S500 
with different sparse sets of the correlation fimction value points to be determined and 
analyzed in each such stage, and/or to modify the comparison performed to determine 
the correlation function value in each such step S400 as outlined above with respect to 
Fig. 8. It should also be appreciated that the exemplary methods shown in Figs. 1 1 

1 5 and 12 and their additional variations as described above are usable indistinguishably 
with both one-dimensional offsets and two-dimensional offsets, as one of ordinary 
skill in the art would readily imderstand. Due to the large number of such 
combinations, specific flowcharts for each such potential combination are not 
included herein. However, in view of the discussion of Figs. 5-10 set forth above, one 

20 of ordinary skill in the art would readily understand the particular steps to be 

performed in such modifications of the exemplary embodiments of the methods 
according to this invention outlined in Figs. 1 1 and 12 to implement such variations. 

[0144] Figs. 13 and 14 show two exemplary embodiments of "smeared" 
high-spatial-frequency images. Conventionally, in the image correlation art, such 

25 smeared images are considered highly undesirable, as the smearing distorts the images 
relative to an unsmeared image, such as that shown in Fig 15. However, as used in 
this invention, an image is "smeared" when the product of the smear speed and the 
exposure time is non-negligible relative to the size of the pixels of the captured image. 
In general, the smear will be non-negligible when the smear is discemable, 

30 appreciable and/or measureable, such as that shown in Figs. 13 and 14. Smearing is 
conventionally believed to significantly distort the shape and location of the 
correlation function peak, and thus interfere with the determination of the actual 
displacement between the reference and displaced images. However, it should be 
August 1,2001 MEI Ref. : 2001-10 

O&BRef: 109942 



43 

appreciated that for image features which are on the order of the pixel size of the 
image capture device, any image captiired while the object being imaged is moving at 
a significant rate relative to the image capture device will have some degree of 
smearing. 

[0145] In general, the amount of smearing S of any image feature compared 
to a stationary image is: 

S - V . ts; (5) 

where: 

V is the velocity vector for a two-dimensional offset (v will be a scalar velocity 
for a one-dimensional offset); and 

ts is the shutter time (or the strobe time of a light source). 

[0146] In particular, the amount of smear S in an image can be determined 
from the peak portion of an auto-correlation function for that image. In particular, it 
should be appreciated that to determine the amount of smear S, only a single image is 
required. The auto-correlation function R(p) for a given pixel displacement (p) for a 
one-dimensional displacement is: 



R{p)-- 



(5) 



[0147] Similarly, the auto-correlation function R (p,q) for a given pixel 
displacement (p,q) for a two-dimensional displacement is: 



Y X Ii(fn,n) * I,(p + m,q + n) 



(6) 



[0148] In practice, since the auto-correlation peak of a given image is 
centered about the p=0 displacement for a one-dimensional offset, or the p=q=0 
displacement for a two-dimensional offset, it is not necessary to determine R(p) or 
R(p,q) for all potential offset values. Rather, R(p) or R(p,q) can be determined only 
for those offsets, or even only a sparse set of those offsets, that lie within the one- or 
two-dimensional peak portion of the correlation function that is centered around the 
(0) or (0,0) offset location. Also, it should be appreciated that it is not necessary to 
use the full image to determine R(p) or R(p,q). Rather, a sub-area of the full image 
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can be used to determine R(p) or R(p,q). Using less than the full image, as discussed 
above with respect to Figs. 6 and 7, will substantially reduce the computation time. 

[0149] Fig. 16 shows the contour plot for the peak portion 620 of the two- 
dimensional correlation fimction 600 of an imsmeared image and the contour plot for 
the peak portion 620' of the two-dimensional correlation function 600' for a smeared 
image. Of course, it should be appreciated that, in actuality, these correlation 
functions are not continuous, as the data points are separated by pixel units of the 
image array used to capture the unsmeared and smeared images. 

[0150] One exemplary embodiment of a fast technique according to this 
invention for determining the smear vector for a two-dimensional translational offset 
(or the scalar smear amount for a one-dimensional offset) without calculating all of 
the correlation function value points that lie within the peak portion of the correlation 
function, and without using all of the array pixels, is to use one row Nx to determine a 
correlation function along the column direction (p) and one column My to determine a 
correlation function along the row direction. That is, the row Nx is correlated to itself 
for various pixel displacements along the column direction (p) and the column My is 
correlated to itself for displacements along the row direction (q). The result of 
determining this sparse set of correlation fimction value points is to effectively 
compute R(p,q) along the p and q directions, as shown by the correlation function 
value points 608 in Fig. 17. However, it should be appreciated that, in practice, to 
improve the signal-to-noise ratio for any given correlation fianction value point 608 of 
Fig. 17, it may be desirable to use more than one row N and/or more column M. In 
general, one to five such rows N or colunms M can reasonably be used for image 
features on the order of the pixel size. 

[0151] Once the correlation function value points 608 along the p and q 
directions have been determined, the widths 624p' and 624q' of the peak portion 620' 
can be determined based on the values of these correlation function points 608. Then, 
the smear in any direction may be determined based on a vector combination of the 
widths 624p' and 624q' of the peak portion 620' along the p and q directions, 
respectively. 

[0152] It should be appreciated that the direction of the maximum length 
vector combination of the widths 624p' and 624q' of the peak portion 620' represents 
the direction of motion occurring at the time the smeared image was captured, that is, 
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this is the direction of the smear vector v. Thus, the orthogonal direction, or the 
direction of the minimum length vector combination of the widths 624p' and 624q' of 
the peak portion 620', is a direction of no relative motion. The difference between 
these two orthogonal vector lengths then corresponds to the actual smeared amount. 
5 [0153] The foregoing analysis also applies to one-dimensional offset imaged 

by a two dimension array. However, for application where the offset is always along a 
defined array axis, the minimum length combination vector may always be along one 
array direction, and will often be a known amount. Thus, for motion restricted to shift 
the image along the p direction, for example, correlation flmction value points are 

1 0 determined only for offsets along the p direction. The amoimt of smear is then 

determined based on the motion-dependent width 424 of the peak portion 420 of the 
correlation function along the p direction, and the known minimum vector length 
along the q direction. 

[0154] Once the smear vector v is determined, it is then possible to predict 

1 5 the approximate relative location of the displaced image 310 relative to the smeared 
reference image 300, assuming that a distance-to-smear function is available. It 
should be appreciated that this distance-to-smear function can be measured or can be 
predicted based on the smear relationship S=vts and a known time elapsed between 
acquisition of the smeared reference image 300 and the displaced image 310. 

20 [0155] It should also be appreciated that this technique assumes that the 

acceleration dxiring and after the analyzed smeared image is captured is not too large. 
That is, this technique is degraded by large accelerations that occur between acquiring 
the smeared reference image and the displaced image. However, by performing the 
exact same analysis on both the smeared reference image and the displaced image, 

25 rather than performing it on only one of the smeared reference image or the displaced 
image, and then comparing the smear results from the reference and displaced images, 
it is possible to determine and at least partially adjust for large accelerations. 

[0156] However, it should be appreciated that while the smear vector v for a 
one or two-dimensional offset determined according to the previous discussion 

30 indicates a line direction, the smear vector actually describes a line along which the 
motion has occurred, but does not indicate which direction along the line the motion 
occurred. Accordingly, the smear magnitude (for a one-dimensional offset) or the 
smear magnitude and line direction (for a two-dimensional offset) can be used to 
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approximately locate two candidate or potential positions of the peak portion 420 or 
620 of the one-dimensional or two-dimensional correlation functions 400 and 600, 
respectively. By knowing the approximate candidate or potential locations in which 
to search for the correlation function peak, it is possible to avoid determining the 
5 correlation function values for correlation function value points that lie away from the 
approximate candidate or potential locations of the correlation function peak, and thus 
find the peak with a reduced number of operations. 

[0157] Alternatively, the displacement determined in an immediately 
previous displacement determination can be used to select the polarity of the smear 

1 0 direction, so that only a single approximate location for the peak portion 420 or 620 
will need to be searched. That is, assuming the acceleration is not too large follov^ng 
the previous displacement determination, the direction of that displacement can be use 
to eliminate one of the two candidate or potential locations. 

[0158] Thus, once the approximate locations of the peak portion 420 or 620 

1 5 is identified using the smear amount and/or direction, a limited range of correlation 
function value points 402 or 606 that includes just the correlation function value 
points 402 or 606 that lie around the approximately determined correlation function 
peak offset position can be determined and analyzed. In various applications, the 
smear procedures set forth above may isolate the approximately determined 

20 correlation function peak offset position with sufficient accuracy that there is little 

utility in further applying the sparse search procedures outlined above. In such cases 
all the correlation fimction value points 402 or 606 that lie in the limited range around 
the approximately determined correlation fimction peak are analyzed as in the '671 
application. Because only those correlation fimction value points that are likely to be 

25 used in determining the actual offset position according to the various techniques 
disclosed in the '671 application are determined, the system resources required to 
determine the offset position are significantly reduced relative to having to search the 
entire correlation space of the correlation function 400 or 600. 

[0159] However, in other applications, the smear procedures set forth above 

30 may isolate the approximately determined correlation function peak offset position 

more crudely, and the limited range may increase significantly. Also, in the case of no 
distinguishable smear the limited range must be set to a maximum. In such cases, the 
smear technique outlined above can be combined with any of the various exemplary 
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embodiments and/or variations of the sparse set of correlation fiinction value points 
technique outlined previously to even further reduce the amount of system resources 
necessary to locate the offset position. That is, as outlined above, the smear 
magnitude or smear vector only approximately locates the position of the correlation 
function peak and the peak portion 420 or 620 of the one-or two-dimensional 
correlation functions 400 and 600, respectively. Thus, using the information about the 
approximate location of the peak portion 420 or 620 provided by the smear magnitude 
or smear vector, respectively, a sparse set of correlation function value points 402 or 
606 can be dynamically determined to allow the approximate location of the peak 
portion 420 or 620, and the correlation peak 422 or 622, respectively, to be 
determined with greater accuracy and/or resolution. 

[0160] Then, as outlined above, a farthest correlation function value point 
402b or 606b of the sparse set of correlation function value points 402 or 606 and the 
surrounding correlation function value points 402 or 606, within the peak portion 420 
or 620 around that farthest correlation function value 402b or 606b are determined. 
Next, any of the various techniques outlined above to determine the full set of 
correlation function value points usable for the techniques outlined in the '671 
application can be used. In this way, even fewer system resources are necessary by 
using this three-stage technique that combines the smear technique and the sparse set 
technique. 

[0161] Fig. 18 is a block diagram outlining in greater detail one exemplary 
embodiment of the signal generating and processing circuitry 200 shown in Fig. 1 . As 
shown in Fig. 1 8, the signal generating and processing circuitry 200 includes a 
controller 210, a light source driver 220, a light detector interface 225, a memory 230, 
a comparing circuit 240, a comparison result accumulator 245, an interpolation circuit 
260, a position accumulator 270, a display driver 201, an optional input interface 204, 
a clock 208, an offset position selector 275, and a correlation function analyzer 280. 

[0162] The controller 210 is connected to the light source driver 220 by a 
signal line 211, to the image detector interface 225 by a signal line 212, and to the 
memory 230 by a signal line 213. Similarly, the controller 210 is connected by signal 
lines 214-218 to the comparing circuit 240, the comparison result accumulator 245, 
the interpolation circuit 260, the position accumulator 270, and the offset position 
selector 275, respectively. Finally, the controller 210 is connected to the display 
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driver 201 by a control line 202 and, if provided, to the input interface 204 by a signal 
line 205. The memory 230 includes a reference image portion 232, a current image 
portion 234, a correlation portion 236, and a set of correlation offset positions portion 
238, and a second stage correlation portion 239. 

[0163] In operation, the controller 210 outputs a control signal over the 
signal line 21 1 to the light source driver 220. In response, the light source driver 220 
outputs a drive signal to the light source 130 over the signal line 132. Subsequently, 
the controller 210 outputs a control signal to the image detector interface 225 and to 
the memory 230 over the signal lines 212 and 213 to store the signal portions received 
over the signal line 164 from the light detector 160 corresponding to each of the image 
elements 162 into the current image portion 234. In particular, the image values from 
the individual image elements 162 are stored in a two-dimensional array in the current 
image portion 234 corresponding to the positions of the individual image elements 
162 in the array 166. 

[0164] Once an image is stored in the reference image portion 232, the 
controller 210 waits the appropriate fixed or controlled time period before outputting 
the control signal on the signal line 21 1 to the light source driver 220 to drive the light 
source 130. The image detector interface 225 and the memory 230 are then controlled 
using signals on the signal lines 212 and 213 to store the resulting image in the current 
image portion 234. 

[0165] Next, under control of the controller 210, the offset position selector 
275 accesses the set of correlation offset positions portion 238. The set of correlation 
offset positions portion 238 stores data defining the set of sparse correlation function 
value points to be used during a first stage to approximately locate the peak portion 
420 or 620 of the one or two-dimensional correlation function 400 or 600. It should 
be appreciated that the sparse set of correlation value points 402 or 606 stored in the 
set of correlation offset positions portion 238 can be predetermined, as outlined above. 
Alternatively, the sparse set of correlation function value points 402 or 606 can be 
dynamically determined, or can be an ordered list of correlation function value points 
to be determined in order as outlined above. 

[0166] Regardless of how the sparse set of correlation function value points 
402 or 606 is determined, the offset position selector 275, under control of the 
controller 210, selects a first correlation function value point from the sparse set of 
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correlation function value points stored in the set of correlation offset positions 
portion 238. The offset position selector 275 then outputs a signal on a signal line 277 
to the comparing circuit 240 that indicates the p dimension offset (for a one- 
dimensional correlation function 400) or the p and q dimension offsets (for a two- 
5 dimensional correlation function 600) to be used by the comparing circuit 240 when 
comparing the displaced image stored in the current image portion 234 to the 
reference image stored in the reference image portion 234. 

[0167] Then, the controller 210 outputs a signal on the signal line 214 to the 
comparing circuit 240. In response, the comparing circuit 240 inputs an image value 

10 for a particular pixel from the reference image portion 232 over a signal line 242 and 
inputs the image value for the corresponding pixel, based on the offset values received 
from the offset position selector 275 for the current one of the sparse set of correlation 
function value points 402 or 606, from the current image portion 234 over the signal 
line 242. The comparing circuit 240 then applies a correlation algorithm to determine 

15 a comparison result. Any appropriate correlation technique, either known or later- 
developed, can be used by the comparing circuit 240 to compare the reference image 
stored in the reference image portion 232 with the current image stored in the current 
image portion 234 on a pixel-by-pixel basis based on the current offset. The 
comparing circuit 240 outputs the comparison result on a signal line 248 to the 

20 comparison result accumulator 245 for the current correlation offset. 

[0168] Once the comparing circuit 240 has extracted and compared the 
image value for at least some of the image elements 162 from the reference image 
portion 232 and compared them to the corresponding image values stored in the 
current image portion 234, and applied the correlation technique and output the 

25 comparison result to the comparison result accumulator 245, the value stored in the 

comparison result accumulator 245 defines the correlation value, corresponding to the 
cvirrent values received from the offset position selector 275 for the current one of the 
sparse set of correlation function value points 402 or 606, in predetermined units. The 
controller 210 then outputs a signal over the signal line 215 to the comparison result 

30 accumulator 245 and to the memory 230 over the signal line 213. As a result, the 

correlation algorithm result stored in the comparison resuh accumulator 245 is output 
and stored in the correlation portion 236 of the memory 230 at a location 
corresponding to the current values received from the offset position selector 275 for 
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the current one of the sparse set of correlation function value points 402 or 606. The 
controller 210 then outputs a signal on the signal line 215 to clear the results stored in 
the correlation portion 236. 

[0169] The controller 210 then outputs a signal on the signal line 215 to 
5 clear the result accumulator 245. Once all of the comparisons for all of the correlation 
function value points of the sparse set of correlation function value points stored in the 
set of correlation offset position portions 238 have been performed by the comparing 
circuit 240, and the results accumulated by the comparison result accumulator 245 and 
stored in the correlation portion 236 under control of the controller 210, the controller 
10 210 outputs a control signal over the signal line 2 1 8 to the correlation function 
analyzer 280. 

[0170] The correlation function analyzer 280, under control of the controller 
210, analyzes the correlation function values stored in the correlation portion 236 to 
identify those correlation fionction value points 402 or 606 of the sparse set of 

1 5 correlation function value points 402 or 602 that lie within the peak portion 420 or 
620 of the correlation function 400 or 600, respectively. The correlation function 
analyzer 280 then outputs, under control of the controller 210, a number of correlation 
function value points 402 or 606 that lie within the peak portion 420 or 620, 
respectively, and that lie at least in a portion of the peak portion 420 or 620 that 

20 surrounds the farthest correlation function value point 402b or 606b to be stored in the 
second stage correlation portion 239. The controller 210 then outputs a signal on the 
signal line 215 to clear the results stored in the correlation portion 236. 

[0171] Then, under control of the controller 210, the comparing circuit 240 
determines correlation function values for each of the correlation function value points 

25 402 or 606 stored in the second stage correlation portion 239. Once all of the 

comparisons for all of the correlation function value points 402 or 606 stored in the 
second stage correlation portion 239 have been performed by the comparing circuit 
240 and the results accumulated by the comparison result of the accumulator 245 and 
stored in the correlation portion 236 under control of the controller 210 the controller 

30 210 outputs a control signal over the signal line 216 to the interpolation circuit 260. 

[0172] In response, the interpolation circuit 260 inputs the correlation results 
stored in the correlation portion 236 over the signal line 242, and identifies correlation 
values coinciding with a peak or trough of the correlation function and interpolates 
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between the identified correlation function value points in the vicinity of the 
peak/trough of the correlation function to determine the peak offset value or image 
displacement value with sub-pixel resolution. The interpolation circuit 260 then 
outputs, under control of the signal over the signal line 216 from the controller 210, 
5 the determined estimated sub-pixel displacement value on a signal line 262 to the 

position accumulator 270. The position accumulator 270, under control of the signal 
over the signal line 217 from the controller 210, adds the estimated displacement 
value to the displacement value for the current reference image stored in the reference 
image portion. The position accumulator 270 then outputs the updated position 

1 0 displacement to the controller 210 over the signal line 272. 

[0173] In response, the controller 210 may output the updated displacement 
value to the display driver 201 , if provided, over the signal line 218. The display 
driver 201 then outputs drive signals over the signal line 203 to the display device 107 
to display the current displacement value. 

1 5 [0174] One or more signal lines 205, if provided, allow an interface between 

an operator or a cooperating system and the controller 210. If provided, the input 
interface 204 may buffer or transform the input signals or commands and transmit the 
appropriate signal to the controller 210. 

[0175] It should also be appreciated that the controller 2 1 0 can control the 

20 offset position selector 275 to select a particular sparse set of correlation function 
value points from a plurality of such sets stored in the set of correlation offset 
positions portions 238 to enable a multistage, rather than a two-stage, analysis 
technique. It should also be appreciated that the controller 210 can control the 
comparison circuit 240 to compare only subsets of the pixels of the reference and 

25 displaced images stored in the reference image portion 232 and the current image 
portion 234, as outlined above with respect to Figs. 6 and 7. 

[0176] Fig. 19 is a block diagram outlining in greater detail a second 
exemplary embodiment of the signal generating and processing circuitry 200 shown in 
Fig. 1. As shown in Fig. 19, the signal generating processing circuitry 200 is 

30 substantially similar to the first exemplary embodiment of the signal generating and a 
processing circuitry 200 shown in Fig. 18, except that in this second exemplary 
embodiment, the signal generating and processing circuitry 200 omits the offset 
position selector 275, but includes a smear amount analyzer 290. In operation, in 
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contrast to the first exemplary embodiment of the signal generating and processing 
circuitry shown in Fig. 18, the controller 210 operates the light source driver 220 
and/or the light detector 160 to create a smeared image, which is stored in the 
reference image portion 232. 

[0177] Then, before waiting the appropriate fixed or controlled time to 
obtain the displaced image to be stored in the current image portion 234, the controller 
210 outputs a signal on the signal line 214 to the comparing circuit 240 to generate the 
data necessary to determine an auto-correlation function for the smeared image stored 
in the reference image portion 232. In general, the comparing circuit 240 and the 
comparison result accumulator 245 are controlled as outlined above by the controller 
210 to generate, accumulate and store correlation function values in the correlation 
portion 236 for the correlation function value points 608 shown in Fig. 17 for a two- 
dimensional offset, or for a corresponding set of correlation function offset points 402 
for a one-dimensional offset. 

[0178] Then, under control of the controller 2 1 0, the smear amount analyzer 
290 analyzes the correlation function value points stored in the correlation portion 236 
to determine the one-dimensional width 424 of the peak portion 420 or the two- 
dimensional widths 624p and 624q of the two-dimensional peak portion 620. The 
smear amount analyzer 290 then determines the smear amount from the determined 
one-dimensional width 424 or the two-dimensional widths 624p and 624q of the peak 
portions 420 or 620, respectively. The smear amount analyzer 290 then determines 
one or two approximate locations for the peak portion 420 or 620 of the correlation 
function to be determined fi-om a comparison of the smeared image stored in the 
reference image portion 232 and a displaced image 3 10 to be captured and stored in 
the current portion 234. 

[0179] Based on these determined approximate locations for the peak 
portion 420 or 620 determined by the smear amount analyzer 290, the sets of 
correlation function value points stored in the set of correlation offset positions 
portions 238 and/or the second stage correlation portion 239 are determined by the 
smeared amount analyzer 290. Then, under control of the controller 210, the 
determined sets of correlation function value points are stored in one or both of the set 
of correlation offset positions portions 238 and/or the second stage correlation portion 
239. 

August 1,2001 MEI Ref. : 2001-10 

O&BRef.: 109942 



53 

[0180] Then, the controller 210, after waiting the appropriate fixed or 
control time, obtains the displaced image and stores it in the current image portion 
234. Then, as outlined above, the controller 210 controls the comparing circuit 240, 
the result of accumulator 245 and the interpolation set circuit 260, based on the set of 
5 correlation function value points stored in the second stage correlation portion 239, to 
determine the actual offset position. 

[0181] Of course, it should be appreciated that the first and second 
embodiments of theses signal generating and processing circuitry 200 outlined above 
and shown in Figs. 18 and 19 can be combined. In this case, after the smear amount 

10 analyzer 290 determines the one or two possible approximate locations for the peak 

portion 420 or 620, rather than storing a full-set of correlation flmction value points to 
be used by the comparing circuit 240 and stored in the second stage correlation 
portion 239, the smear amount analyzer 290 dynamically determines at least one 
sparse set of correlation function value points 402 or 606 based on the possible 

15 approximate locations for the peak portions 420 or 620, which are stored, under 
control of the controller 210, in the set of correlation offset positions portion 238. 
Then, after the displaced image is captured and stored in the current image portion 
234, the controller 210, as outlined above with respect to the first exemplary 
embodiment of the signal generating and processing circuitry 200, operates the 

20 comparing circuit 240 based on that at least one sparse set of correlation function 
value points 402 or 606 as outlined above with respect to the first exemplary 
embodiment of the signal generating and processing circuitry 200 shown in Fig. 18. 

[0182] The signal generating and processing circuitry 200 is, in various 
exemplary embodiments, implemented using a programmed microprocessor or 

25 microcontroller and peripheral integrated circuit elements. However, the signal 

generating and processing chcuitry 200 can also be implemented using a programmed 
general purpose computer, a special purpose computer, an ASIC or other integrated 
circuit, a digital signal processor, a hardvdred electronic or logic circuit such as a 
discrete element circuit, a programmable logic device such as a PLD, PLA, FPGA or 

30 PAL, or the like. In general, any device, capable of implementing a finite state machine 
that is in turn capable of implementing any one or more of the methods outlined above 
can be used to implement the signal generating and processing circuitry 200. 
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[0183] In Figs. 1 8 and 1 9, the memory 230 in the signal generating and 
processing circuitry 200 can be implemented using any appropriate combination of 
alterable, volatile or non-volatile memory or non-alterable, or fixed, memory. The 
alterable memory, whether volatile or non- volatile, can be implemented using any one or 
5 more of static or dynamic RAM, a floppy disk and disk drive, a writeable or re- 

rewriteable optical disk and disk drive, a hard drive, flash memory, a memory stick or 
the like. Similarly, the non-alterable or fixed memory can be implemented using any 
one or more of ROM, PROM, EPROM, EEPROM, an optical ROM disk, such as a CD- 
ROM or DVD-ROM disk, and associated disk drive, or the like. 

1 0 [01 84] Thus, it should be understood that each of the controller 2 1 0 and the 

various other circuits 220, 225 and 240-290 of the signal generating and processing 
circuitry 200 can be implemented as portions of a suitably programmed general 
purpose computer, macroprocessor or microprocessor. Alternatively, each of the 
controller 210 and the other circuits 220, 225 and 240-290 shown in Figs. 18 and 19 

1 5 can be implemented as physically distinct hardware circuits within an ASIC, or using 
a FPGA, a PDL, a PLA or a PAL, or using discrete logic elements or discrete circuit 
elements. The particular form each of the circuits 220, 225, 240-290 of the signal 
generating and processing circuitry 200 will take is a design choice and will be obvious 
and predicable to those skilled in the art. 

20 [0185] While this invention has been described in conjimction with the 

exemplary embodiments outlined above, it is evident that many alternatives, 
modifications and variations will be apparent to those skilled in the art. Accordingly, 
the exemplary embodiments of the invention, as set forth above, are intended to be 
illustrative, not limiting. Various changes may be made without departing from the 

25 spirit and scope of the invention. 
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